[ 532.869050] env[69692]: INFO neutron.common.config [-] Logging enabled! [ 532.869050] env[69692]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43 [ 532.869050] env[69692]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69692) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 532.869050] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 532.869050] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 532.869050] env[69692]: WARNING oslo_policy.policy [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 532.869050] env[69692]: WARNING oslo_policy.policy [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 532.869966] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] VMware NSXv3 Agent initialized successfully. [ 532.870292] env[69692]: DEBUG oslo_concurrency.lockutils [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] Acquiring lock "singleton_lock" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.870546] env[69692]: DEBUG oslo_concurrency.lockutils [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] Acquired lock "singleton_lock" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.870623] env[69692]: DEBUG oslo_concurrency.lockutils [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] Releasing lock "singleton_lock" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.870946] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] Full set of CONF: {{(pid=69692) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 532.871149] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ******************************************************************************** {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 532.871270] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] Configuration options gathered from: {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 532.872030] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 532.872030] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 532.872030] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ================================================================================ {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 532.872030] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] agent_down_time = 75 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.873499] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] allow_automatic_dhcp_failover = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.873499] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] allow_bulk = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.873499] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] api_extensions_path = {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.873499] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] api_paste_config = api-paste.ini {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.873499] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] auth_strategy = keystone {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.873499] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] backdoor_port = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.873499] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] backdoor_socket = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.873818] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] backlog = 4096 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.873818] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] base_mac = fa:16:3e:00:00:00 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.873818] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] bind_host = 0.0.0.0 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.873818] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] bind_port = 9696 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.873818] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] client_socket_timeout = 900 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.873818] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] config_dir = [] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.874066] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.874066] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] config_source = [] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.874179] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] control_exchange = neutron {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.874322] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] core_plugin = ml2 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.874653] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] debug = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.874653] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] default_availability_zones = [] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.874805] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.874948] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] dhcp_agent_notification = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.875112] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] dhcp_agents_per_network = 1 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.875232] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] dhcp_lease_duration = 86400 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.875378] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] dhcp_load_type = networks {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.875519] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] dns_domain = openstacklocal {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.875661] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.875795] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] enable_default_route_bfd = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.875929] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] enable_default_route_ecmp = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.876072] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] enable_dvr = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.876208] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] enable_new_agents = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.876342] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.876495] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] enable_signals = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.876643] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] enable_traditional_dhcp = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.876777] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] external_dns_driver = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.876911] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] filter_validation = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.877069] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] global_physnet_mtu = 8950 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.877213] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] graceful_shutdown_timeout = 60 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.877387] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] host = cpu-1 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.877529] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] host_dvr_for_dhcp = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.877668] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] http_retries = 3 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.877831] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] instance_format = [instance: %(uuid)s] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.877977] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.878133] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ipam_driver = internal {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.878271] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ipv6_pd_enabled = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.878406] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] l3_ha = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.878551] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.878694] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] l3_ha_network_physical_name = {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.878859] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] l3_ha_network_type = {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.879014] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] log_color = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.879163] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] log_config_append = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.879309] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.879447] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] log_dir = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.879583] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] log_file = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.879690] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] log_options = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.879829] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] log_rotate_interval = 1 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.880075] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] log_rotate_interval_type = days {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.880152] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] log_rotation_type = none {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.880226] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.880330] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.880473] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.880614] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.880723] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.880894] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] max_dns_nameservers = 5 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.881064] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] max_header_line = 16384 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.881199] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] max_l3_agents_per_router = 3 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.881336] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] max_logfile_count = 30 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.881472] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] max_logfile_size_mb = 200 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.881609] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] max_subnet_host_routes = 20 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.881754] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] my_ip = 10.180.1.21 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.881900] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] my_ipv6 = ::1 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.882051] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] network_auto_schedule = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.882189] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] network_link_prefix = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.882333] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.882481] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] notify_nova_on_port_data_changes = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.882623] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] notify_nova_on_port_status_changes = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.882766] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] pagination_max_limit = -1 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.882904] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] publish_errors = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.884319] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] rate_limit_burst = 0 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.884319] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] rate_limit_except_level = CRITICAL {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.884319] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] rate_limit_interval = 0 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.884319] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] retry_until_window = 30 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.884319] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] router_distributed = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.884319] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] rpc_resources_processing_step = 20 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.884319] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] rpc_response_max_timeout = 600 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.884679] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] rpc_response_timeout = 60 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.884679] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] send_events_interval = 2 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.884679] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] service_plugins = ['router'] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.884679] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] setproctitle = on {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.884679] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] shell_completion = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.885061] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] state_path = /opt/stack/data/neutron {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.885061] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] syslog_log_facility = LOG_USER {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.885061] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] tcp_keepidle = 600 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.885189] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] transport_url = **** {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.885239] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] use_journal = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.885363] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] use_json = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.885501] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] use_ssl = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.885623] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] use_stderr = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.885762] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] use_syslog = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.885897] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] vlan_qinq = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.886041] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] vlan_transparent = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.886182] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] watch_log_file = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.886320] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] wsgi_default_pool_size = 100 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.886453] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] wsgi_keep_alive = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.886596] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.886737] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] wsgi_server_debug = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 532.886910] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_concurrency.disable_process_locking = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.887091] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.887232] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.887373] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.887518] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.887663] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.887824] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.887985] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler.connection_string = messaging:// {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.888146] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler.enabled = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.888298] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler.es_doc_type = notification {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.888431] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler.es_scroll_size = 10000 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.888576] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler.es_scroll_time = 2m {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.888715] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler.filter_error_trace = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.888861] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler.hmac_keys = **** {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.889027] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler.sentinel_service_name = mymaster {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.889169] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler.socket_timeout = 0.1 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.889310] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler.trace_requests = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.889450] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler.trace_sqlalchemy = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.889601] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler_jaeger.process_tags = {} {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.889741] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler_jaeger.service_name_prefix = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.889904] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] profiler_otlp.service_name_prefix = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.890090] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_policy.enforce_new_defaults = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.890359] env[69692]: WARNING oslo_config.cfg [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 532.890514] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_policy.enforce_scope = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.890664] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_policy.policy_default_rule = default {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.890819] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.890969] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.891128] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.891268] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.891405] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.891539] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.891676] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.891819] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_policy.remote_timeout = 60.0 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.891974] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.892135] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] agent.extensions = [] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.892283] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.892425] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] service_providers.service_provider = [] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.892574] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] QUOTAS.default_quota = -1 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.892721] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.892888] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] QUOTAS.quota_floatingip = 50 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.893061] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] QUOTAS.quota_network = 100 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.893206] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] QUOTAS.quota_port = 500 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.893347] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.893482] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] QUOTAS.quota_router = 10 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.893620] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] QUOTAS.quota_security_group = 10 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.893756] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.893894] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] QUOTAS.quota_subnet = 100 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.894044] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] QUOTAS.track_quota_usage = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.894200] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.894338] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep.group = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.894475] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep.helper_command = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.894616] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.894759] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep.thread_pool_size = 8 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.894896] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep.user = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.895049] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.895186] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_dhcp_release.group = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.895318] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_dhcp_release.helper_command = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.895456] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.895594] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.895726] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_dhcp_release.user = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.895886] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.896046] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_ovs_vsctl.group = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.896190] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_ovs_vsctl.helper_command = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.896333] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.896472] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.896605] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_ovs_vsctl.user = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.896748] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_namespace.capabilities = [21] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.896881] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_namespace.group = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.897020] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_namespace.helper_command = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.897165] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.897306] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_namespace.thread_pool_size = 8 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.897441] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_namespace.user = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.897586] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_conntrack.capabilities = [12] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.897746] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_conntrack.group = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.897884] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_conntrack.helper_command = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.898039] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.898183] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.898319] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_conntrack.user = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.898465] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_link.capabilities = [12, 21] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.898602] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_link.group = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.898760] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_link.helper_command = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.898917] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.899072] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_link.thread_pool_size = 8 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.899211] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] privsep_link.user = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.899368] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.899518] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.899661] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.continue_on_failed_promotions = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.899801] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.dscp = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.899944] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.dscp_inherit = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.900130] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.force_mp_to_policy = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.900265] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.locking_coordinator_url = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.900373] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.log_agent_heartbeats = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.900513] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.logging_expire = 1 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.900660] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.900799] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.900949] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.polling_interval = 240 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.901111] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.901259] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.901402] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.report_interval = 30.0 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.901548] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.901692] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.901858] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.902013] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.sync_skew = 60 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.902163] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.synchronization_queue_size = 20 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.902309] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT.use_helper_for_ns_read = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.902457] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] SECURITYGROUP.enable_ipset = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.902605] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] SECURITYGROUP.enable_security_group = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.902753] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.902899] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.903057] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] experimental.ipv6_pd_enabled = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.903218] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ml2.extension_drivers = ['port_security'] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.903373] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ml2.external_network_type = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.903508] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.903657] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ml2.overlay_ip_version = 4 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.903803] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ml2.path_mtu = 8950 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.903952] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ml2.physical_network_mtus = {} {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.904113] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ml2.tenant_network_types = ['vlan'] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.904263] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.904410] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ml2.type_drivers = ['vlan'] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.904558] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT_CLI.neutron_port_id = [] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.904699] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.904867] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.905048] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.905205] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.905355] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.905501] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.905652] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.905798] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.905988] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.906155] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_login_password = **** {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.906307] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_login_port = 443 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.906453] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_login_user = admin {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.906599] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.906747] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.906892] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.907042] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.907186] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.907336] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.907480] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.907625] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.907886] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.907968] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.908139] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.908281] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.908423] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.908634] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.908778] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] vsphere.vsphere_login_password = VMware1! {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.908937] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.909093] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.909240] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] nova.auth_section = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.909392] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] nova.auth_type = password {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.909539] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.909676] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] nova.certfile = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.909819] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] nova.collect_timing = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.909970] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] nova.endpoint_type = public {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.910123] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] nova.insecure = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.910260] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] nova.keyfile = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.910404] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] nova.region_name = RegionOne {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.910542] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] nova.split_loggers = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.910717] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] nova.timeout = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.910826] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] placement.auth_section = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.911042] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] placement.auth_type = password {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.911206] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.911346] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] placement.certfile = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.911490] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] placement.collect_timing = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.911637] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] placement.endpoint_type = public {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.911777] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] placement.insecure = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.911916] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] placement.keyfile = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.912063] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] placement.region_name = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.912198] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] placement.split_loggers = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.912337] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] placement.timeout = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.912480] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.auth_section = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.912620] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.auth_type = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.912755] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.cafile = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.912900] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.certfile = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.913034] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.collect_timing = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.913172] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.connect_retries = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.913307] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.connect_retry_delay = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.913443] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.enable_notifications = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.913575] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.endpoint_override = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.913709] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.insecure = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.913849] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.interface = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.914015] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.keyfile = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.914192] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.max_version = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.914297] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.min_version = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.914435] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.region_name = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.914572] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.retriable_status_codes = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.914708] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.service_name = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.914843] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.service_type = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.914988] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.split_loggers = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.915134] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.status_code_retries = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.915269] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.status_code_retry_delay = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919020] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.timeout = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919020] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.valid_interfaces = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919020] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ironic.version = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919020] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] cli_script.dry_run = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919020] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919020] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919020] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919301] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919301] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919301] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919301] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919301] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919301] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919453] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919453] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919453] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919453] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919453] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919453] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919597] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919597] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919597] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919597] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919597] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919597] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919738] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919738] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919738] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919738] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919738] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919738] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919885] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.919885] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.920127] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.920169] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.ssl = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.920297] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.920439] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.920573] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.920721] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.920863] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.ssl_version = {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.920999] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.921154] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_notifications.driver = [] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.921293] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_notifications.retry = -1 {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.921443] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.921574] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] oslo_messaging_notifications.transport_url = **** {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 532.921681] env[69692]: DEBUG oslo_service.backend.eventlet.service [None req-5a3607b1-f986-4bec-af84-fcc47890c36b None None] ******************************************************************************** {{(pid=69692) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 532.922657] env[69692]: DEBUG neutron.agent.securitygroups_rpc [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Init firewall settings (driver=nsxv3) {{(pid=69692) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 532.925079] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69692) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 532.925079] env[69692]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] RPC agent_id: nsxm-l-01a.corp.local [ 532.926465] env[69692]: DEBUG dogpile.cache.region [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 532.926577] env[69692]: DEBUG dogpile.lock [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 532.926673] env[69692]: DEBUG dogpile.lock [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 532.926770] env[69692]: DEBUG dogpile.lock [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 532.926861] env[69692]: DEBUG dogpile.cache.region [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 532.926947] env[69692]: DEBUG dogpile.lock [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 532.927081] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 532.964858] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Session token - acquiring [ 532.966397] env[69692]: DEBUG networking_nsxv3.common.locking [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 532.966577] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 532.966680] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 532.967116] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 532.977438] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.246513] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 533.267390] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 533.267390] env[69692]: DEBUG dogpile.cache.region [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Cache value generated in 0.340 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 533.267518] env[69692]: DEBUG dogpile.lock [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 533.267627] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Activating Policy API Provider. [ 533.267896] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Looking for the default Infrastructure Rules. [ 533.328849] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Looking for the Default Layer3 Logged Drop Section. [ 533.344017] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 533.344462] env[69692]: DEBUG networking_nsxv3.common.locking [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.344628] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquiring lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.344733] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.344999] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired external semaphore "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.345344] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 533.859702] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 534.362743] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 534.865192] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Inventory metadata is going to be refreshed. [ 534.865379] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 535.615819] env[69692]: DEBUG networking_nsxv3.common.locking [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.616255] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.616255] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.616455] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.731219] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 535.732170] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.733077] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 535.751853] env[69692]: DEBUG networking_nsxv3.common.locking [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.752041] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.752154] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.752424] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.752550] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.752692] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 535.752817] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.752935] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 535.770653] env[69692]: DEBUG networking_nsxv3.common.locking [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.770903] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.770903] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.771193] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.771368] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.771508] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 535.789623] env[69692]: DEBUG networking_nsxv3.common.locking [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.789800] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.789908] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.790179] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.790323] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.790461] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 535.807877] env[69692]: DEBUG networking_nsxv3.common.locking [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.808170] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquiring lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.808170] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.808448] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired external semaphore "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.808588] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Releasing lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.808735] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 535.808854] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.808970] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 535.826083] env[69692]: DEBUG networking_nsxv3.common.locking [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.826291] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquiring lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.826409] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.826631] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired external semaphore "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.826758] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Releasing lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.826896] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 535.827017] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.827135] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 535.847568] env[69692]: DEBUG networking_nsxv3.common.locking [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.847827] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.847827] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.848133] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.848272] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.848420] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 535.848526] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 535.848627] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Inventory metadata have been refreshed. [ 535.848725] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Dryrun:True. Metadata refresh completed. [ 535.848861] env[69692]: DEBUG oslo_concurrency.lockutils [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Releasing lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.850575] env[69692]: INFO neutron.agent.agent_extensions_manager [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Loaded agent extensions: [] [ 535.851278] env[69692]: DEBUG neutron_lib.callbacks.manager [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69692) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 535.899208] env[69692]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] NSXv3 Agent Agent RPC Daemon Started! [ 535.899322] env[69692]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] NSXv3 Agent Agent loop - iteration:0 started [ 535.899666] env[69692]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] NSXv3 Agent Agent out of sync with plugin! [ 540.852011] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 540.852409] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 545.854143] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 545.854553] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 549.835264] env[69692]: INFO networking_nsxv3.common.synchronization [None req-ae404944-60e5-48a9-a4ac-ccd4be4953c4 demo admin] Enqueued Resource ID: 735d25e2-b454-4fa0-9e34-5367bc51e6c5 with Priority: HIGHEST for action security_group_rules [ 549.835795] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 735d25e2-b454-4fa0-9e34-5367bc51e6c5 with Priority: HIGHEST for action security_group_rules [ 549.836165] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-735d25e2-b454-4fa0-9e34-5367bc51e6c5 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.836284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-735d25e2-b454-4fa0-9e34-5367bc51e6c5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.836337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-735d25e2-b454-4fa0-9e34-5367bc51e6c5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.836636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-735d25e2-b454-4fa0-9e34-5367bc51e6c5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.836716] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('735d25e2-b454-4fa0-9e34-5367bc51e6c5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 550.360545] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.360545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.360545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.360545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.360545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.360545] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 735d25e2-b454-4fa0-9e34-5367bc51e6c5 already deleted. [ 550.360545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-735d25e2-b454-4fa0-9e34-5367bc51e6c5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.837223] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 554.837590] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 554.854132] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.854317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.854317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.854536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.854768] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.357618] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.860434] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 556.363061] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 556.363256] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 557.083841] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.084256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.084256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.084256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.094874] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 557.095669] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.096443] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 557.113207] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.113353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.113394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.113565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.113647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.113745] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 557.113816] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 557.113885] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 557.135546] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.135694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.135732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.135886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.136017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.136119] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 557.155698] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.155831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.155868] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.156027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.156121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.156234] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 557.174981] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.175119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.175189] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.175329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.175418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.175516] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 557.175586] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 557.175650] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 557.192237] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.192375] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.192434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.192554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.192632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.192721] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 557.192790] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 557.192856] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 557.210738] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.210855] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.210928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.211078] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.211170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.211277] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 557.211388] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 557.211388] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 557.211492] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 557.211536] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 557.211584] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 557.211630] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 557.211877] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 557.211939] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 557.212013] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 557.230145] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.230242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.230307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.230465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.230555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.230647] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 557.251481] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.251611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.251649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.251786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.251875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.264217] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.838921] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 559.839243] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 564.840607] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 564.840952] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 569.841984] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 569.842351] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 574.843348] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 574.843759] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 578.122265] env[69692]: INFO networking_nsxv3.common.synchronization [None req-7e55ec20-6a57-4cbb-a73e-4a83c787dbef None None] Enqueued Resource ID: cb5a2899-1fcc-4543-be6b-7c4fc6ec5ca0 with Priority: HIGHEST for action port [ 578.122544] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb5a2899-1fcc-4543-be6b-7c4fc6ec5ca0 with Priority: HIGHEST for action port [ 578.123931] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb5a2899-1fcc-4543-be6b-7c4fc6ec5ca0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.123931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb5a2899-1fcc-4543-be6b-7c4fc6ec5ca0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.123931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb5a2899-1fcc-4543-be6b-7c4fc6ec5ca0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.124117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb5a2899-1fcc-4543-be6b-7c4fc6ec5ca0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.124168] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb5a2899-1fcc-4543-be6b-7c4fc6ec5ca0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.626229] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb5a2899-1fcc-4543-be6b-7c4fc6ec5ca0 [ 578.626508] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.626617] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.626660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.627125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.627125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.627125] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb5a2899-1fcc-4543-be6b-7c4fc6ec5ca0 already deleted. [ 578.627125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb5a2899-1fcc-4543-be6b-7c4fc6ec5ca0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.082516] env[69692]: INFO networking_nsxv3.common.synchronization [None req-6cb8b757-7bc0-4e07-95f1-cecb0737d568 None None] Enqueued Resource ID: 2320feba-ddac-4972-b020-2e22f896172c with Priority: HIGHEST for action port [ 580.082516] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2320feba-ddac-4972-b020-2e22f896172c with Priority: HIGHEST for action port [ 580.082516] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-2320feba-ddac-4972-b020-2e22f896172c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.082516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2320feba-ddac-4972-b020-2e22f896172c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.082516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2320feba-ddac-4972-b020-2e22f896172c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.082516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2320feba-ddac-4972-b020-2e22f896172c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.082516] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2320feba-ddac-4972-b020-2e22f896172c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.585691] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2320feba-ddac-4972-b020-2e22f896172c [ 580.586281] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.586528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.588693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.588693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.588693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.588693] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2320feba-ddac-4972-b020-2e22f896172c already deleted. [ 580.588693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2320feba-ddac-4972-b020-2e22f896172c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.251483] env[69692]: INFO networking_nsxv3.common.synchronization [None req-1dfcad12-a00b-4090-8dc7-8d2c95048e88 None None] Enqueued Resource ID: 0d2c8af2-ea59-4c4f-ad6c-a8730d7982fe with Priority: HIGHEST for action port [ 581.251761] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d2c8af2-ea59-4c4f-ad6c-a8730d7982fe with Priority: HIGHEST for action port [ 581.252629] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d2c8af2-ea59-4c4f-ad6c-a8730d7982fe taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.252772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d2c8af2-ea59-4c4f-ad6c-a8730d7982fe" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.252837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d2c8af2-ea59-4c4f-ad6c-a8730d7982fe" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.253659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d2c8af2-ea59-4c4f-ad6c-a8730d7982fe" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.253736] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d2c8af2-ea59-4c4f-ad6c-a8730d7982fe',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.757939] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d2c8af2-ea59-4c4f-ad6c-a8730d7982fe [ 581.757939] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.757939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.757939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.758353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.759027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.759027] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d2c8af2-ea59-4c4f-ad6c-a8730d7982fe already deleted. [ 581.759027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d2c8af2-ea59-4c4f-ad6c-a8730d7982fe" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.530410] env[69692]: INFO networking_nsxv3.common.synchronization [None req-b63dbb6f-44af-4196-9910-3975770a56cc None None] Enqueued Resource ID: 1f748630-4acd-466e-b921-6d659a2ce92a with Priority: HIGHEST for action port [ 582.530771] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f748630-4acd-466e-b921-6d659a2ce92a with Priority: HIGHEST for action port [ 582.531228] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f748630-4acd-466e-b921-6d659a2ce92a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.531421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f748630-4acd-466e-b921-6d659a2ce92a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.531421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f748630-4acd-466e-b921-6d659a2ce92a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.531647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f748630-4acd-466e-b921-6d659a2ce92a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.531724] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f748630-4acd-466e-b921-6d659a2ce92a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.037741] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f748630-4acd-466e-b921-6d659a2ce92a [ 583.037741] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.037741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.037741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.037741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.037741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.037741] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f748630-4acd-466e-b921-6d659a2ce92a already deleted. [ 583.037741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f748630-4acd-466e-b921-6d659a2ce92a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.609606] env[69692]: INFO networking_nsxv3.common.synchronization [None req-0efcc78f-5d03-46b2-b390-e764f4f9e3af None None] Enqueued Resource ID: 070d72bc-8bb1-4cb5-b3ba-941516683be2 with Priority: HIGHEST for action port [ 583.609858] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070d72bc-8bb1-4cb5-b3ba-941516683be2 with Priority: HIGHEST for action port [ 583.610421] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-070d72bc-8bb1-4cb5-b3ba-941516683be2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.610538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-070d72bc-8bb1-4cb5-b3ba-941516683be2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.610614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-070d72bc-8bb1-4cb5-b3ba-941516683be2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.610864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-070d72bc-8bb1-4cb5-b3ba-941516683be2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.610941] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('070d72bc-8bb1-4cb5-b3ba-941516683be2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.070271] env[69692]: INFO networking_nsxv3.common.synchronization [None req-887ef693-870f-4c86-906e-8280a3721de6 None None] Enqueued Resource ID: 3709aa88-4c10-4ae2-bfde-9bebd7ee83be with Priority: HIGHEST for action port [ 584.070979] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3709aa88-4c10-4ae2-bfde-9bebd7ee83be with Priority: HIGHEST for action port [ 584.071697] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-3709aa88-4c10-4ae2-bfde-9bebd7ee83be taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.071773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3709aa88-4c10-4ae2-bfde-9bebd7ee83be" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.071841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3709aa88-4c10-4ae2-bfde-9bebd7ee83be" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.072148] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3709aa88-4c10-4ae2-bfde-9bebd7ee83be" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.072148] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3709aa88-4c10-4ae2-bfde-9bebd7ee83be',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.112979] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 070d72bc-8bb1-4cb5-b3ba-941516683be2 [ 584.113260] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.113395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.113568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.113668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.113755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.113843] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:070d72bc-8bb1-4cb5-b3ba-941516683be2 already deleted. [ 584.113920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-070d72bc-8bb1-4cb5-b3ba-941516683be2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.319686] env[69692]: INFO networking_nsxv3.common.synchronization [None req-c8c6ea6c-f17f-4fae-8f88-7064cbb57645 None None] Enqueued Resource ID: e54d508d-a188-413f-9979-5d7a41d4dd94 with Priority: HIGHEST for action port [ 584.319927] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e54d508d-a188-413f-9979-5d7a41d4dd94 with Priority: HIGHEST for action port [ 584.324338] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-e54d508d-a188-413f-9979-5d7a41d4dd94 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.324654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e54d508d-a188-413f-9979-5d7a41d4dd94" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.324654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e54d508d-a188-413f-9979-5d7a41d4dd94" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.329320] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e54d508d-a188-413f-9979-5d7a41d4dd94" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.329409] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e54d508d-a188-413f-9979-5d7a41d4dd94',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.576056] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3709aa88-4c10-4ae2-bfde-9bebd7ee83be [ 584.576056] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.576056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.576056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.576056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.576056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.576056] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3709aa88-4c10-4ae2-bfde-9bebd7ee83be already deleted. [ 584.576056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3709aa88-4c10-4ae2-bfde-9bebd7ee83be" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.834274] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e54d508d-a188-413f-9979-5d7a41d4dd94 [ 584.834274] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.834274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.834274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.834274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.834274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.836256] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e54d508d-a188-413f-9979-5d7a41d4dd94 already deleted. [ 584.836256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e54d508d-a188-413f-9979-5d7a41d4dd94" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.058330] env[69692]: INFO networking_nsxv3.common.synchronization [None req-011c71b3-a155-4f59-ba45-eda90405b701 None None] Enqueued Resource ID: cbbc8c5f-9a44-4c64-9bfa-3395d86f74e5 with Priority: HIGHEST for action port [ 585.058584] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbbc8c5f-9a44-4c64-9bfa-3395d86f74e5 with Priority: HIGHEST for action port [ 585.059219] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbbc8c5f-9a44-4c64-9bfa-3395d86f74e5 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.059347] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbbc8c5f-9a44-4c64-9bfa-3395d86f74e5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.059470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbbc8c5f-9a44-4c64-9bfa-3395d86f74e5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.059689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbbc8c5f-9a44-4c64-9bfa-3395d86f74e5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.059759] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbbc8c5f-9a44-4c64-9bfa-3395d86f74e5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.423792] env[69692]: INFO networking_nsxv3.common.synchronization [None req-ac62c80f-afa9-4226-ba8d-c9c8bcb100f4 None None] Enqueued Resource ID: 8febe626-8a20-4cad-a6ed-6a1b49873932 with Priority: HIGHEST for action port [ 585.424065] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8febe626-8a20-4cad-a6ed-6a1b49873932 with Priority: HIGHEST for action port [ 585.424727] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-8febe626-8a20-4cad-a6ed-6a1b49873932 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.424831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8febe626-8a20-4cad-a6ed-6a1b49873932" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.424831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8febe626-8a20-4cad-a6ed-6a1b49873932" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.426392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8febe626-8a20-4cad-a6ed-6a1b49873932" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.426619] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8febe626-8a20-4cad-a6ed-6a1b49873932',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.562311] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbbc8c5f-9a44-4c64-9bfa-3395d86f74e5 [ 585.562487] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.562645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.562697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.562877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.562961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.563073] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbbc8c5f-9a44-4c64-9bfa-3395d86f74e5 already deleted. [ 585.564191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbbc8c5f-9a44-4c64-9bfa-3395d86f74e5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.929783] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8febe626-8a20-4cad-a6ed-6a1b49873932 [ 585.930928] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.930928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.930928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.930928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.930928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.930928] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8febe626-8a20-4cad-a6ed-6a1b49873932 already deleted. [ 585.930928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8febe626-8a20-4cad-a6ed-6a1b49873932" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.956504] env[69692]: INFO networking_nsxv3.common.synchronization [None req-1c2066fa-969d-4ccc-bc2f-bf3ffda532b8 None None] Enqueued Resource ID: fbe4770e-f5df-4021-af47-6d621f64b600 with Priority: HIGHEST for action port [ 585.957092] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe4770e-f5df-4021-af47-6d621f64b600 with Priority: HIGHEST for action port [ 585.958843] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbe4770e-f5df-4021-af47-6d621f64b600 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.958843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbe4770e-f5df-4021-af47-6d621f64b600" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.958843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbe4770e-f5df-4021-af47-6d621f64b600" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.958843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbe4770e-f5df-4021-af47-6d621f64b600" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.959255] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbe4770e-f5df-4021-af47-6d621f64b600',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.433927] env[69692]: INFO networking_nsxv3.common.synchronization [None req-7e372ae5-55ac-441e-9c52-ae0f72d83c2d None None] Enqueued Resource ID: fbf058d4-1254-4e8a-a934-1f4051bf4ee4 with Priority: HIGHEST for action port [ 586.433927] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf058d4-1254-4e8a-a934-1f4051bf4ee4 with Priority: HIGHEST for action port [ 586.434443] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbf058d4-1254-4e8a-a934-1f4051bf4ee4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.434443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbf058d4-1254-4e8a-a934-1f4051bf4ee4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.434443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbf058d4-1254-4e8a-a934-1f4051bf4ee4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.434443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbf058d4-1254-4e8a-a934-1f4051bf4ee4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.434857] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbf058d4-1254-4e8a-a934-1f4051bf4ee4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.461297] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbe4770e-f5df-4021-af47-6d621f64b600 [ 586.462712] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.462712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.462712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.462712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.462712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.462712] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbe4770e-f5df-4021-af47-6d621f64b600 already deleted. [ 586.462712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbe4770e-f5df-4021-af47-6d621f64b600" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.937821] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbf058d4-1254-4e8a-a934-1f4051bf4ee4 [ 586.938364] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.938364] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.938364] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.938608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.938608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.938608] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbf058d4-1254-4e8a-a934-1f4051bf4ee4 already deleted. [ 586.938731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbf058d4-1254-4e8a-a934-1f4051bf4ee4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.152369] env[69692]: INFO networking_nsxv3.common.synchronization [None req-a14c66db-bd67-495a-a80f-c27a74e9ef20 None None] Enqueued Resource ID: 1b012d41-5824-42a7-a203-cf0e21154115 with Priority: HIGHEST for action port [ 587.153283] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b012d41-5824-42a7-a203-cf0e21154115 with Priority: HIGHEST for action port [ 587.153283] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b012d41-5824-42a7-a203-cf0e21154115 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.153283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b012d41-5824-42a7-a203-cf0e21154115" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.153283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b012d41-5824-42a7-a203-cf0e21154115" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.153921] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b012d41-5824-42a7-a203-cf0e21154115" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.153921] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b012d41-5824-42a7-a203-cf0e21154115',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.654061] env[69692]: INFO networking_nsxv3.common.synchronization [None req-8d0cbc43-8405-4f37-9cef-87439f6e51c4 None None] Enqueued Resource ID: 6c58f55c-6835-4fc6-8eda-7e3ef4a85320 with Priority: HIGHEST for action port [ 587.654186] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c58f55c-6835-4fc6-8eda-7e3ef4a85320 with Priority: HIGHEST for action port [ 587.654697] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c58f55c-6835-4fc6-8eda-7e3ef4a85320 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.654819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c58f55c-6835-4fc6-8eda-7e3ef4a85320" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.654883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c58f55c-6835-4fc6-8eda-7e3ef4a85320" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.655159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c58f55c-6835-4fc6-8eda-7e3ef4a85320" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.655238] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c58f55c-6835-4fc6-8eda-7e3ef4a85320',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.655976] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b012d41-5824-42a7-a203-cf0e21154115 [ 587.656977] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.657187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.657300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.657569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.657676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.657772] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b012d41-5824-42a7-a203-cf0e21154115 already deleted. [ 587.657961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b012d41-5824-42a7-a203-cf0e21154115" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.160289] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c58f55c-6835-4fc6-8eda-7e3ef4a85320 [ 588.160289] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.160289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.160289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.160289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.160289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.160289] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c58f55c-6835-4fc6-8eda-7e3ef4a85320 already deleted. [ 588.160289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c58f55c-6835-4fc6-8eda-7e3ef4a85320" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.421727] env[69692]: INFO networking_nsxv3.common.synchronization [None req-77159cc7-f341-4260-abde-4f31d7051aba None None] Enqueued Resource ID: 842e410d-6a7d-46d4-b27d-b2270b0182e1 with Priority: HIGHEST for action port [ 589.421999] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 842e410d-6a7d-46d4-b27d-b2270b0182e1 with Priority: HIGHEST for action port [ 589.422536] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-842e410d-6a7d-46d4-b27d-b2270b0182e1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.422657] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-842e410d-6a7d-46d4-b27d-b2270b0182e1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.422728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-842e410d-6a7d-46d4-b27d-b2270b0182e1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.422980] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-842e410d-6a7d-46d4-b27d-b2270b0182e1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.425342] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('842e410d-6a7d-46d4-b27d-b2270b0182e1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.564845] env[69692]: INFO networking_nsxv3.common.synchronization [None req-7daebb9c-b5eb-48e8-866e-0d37a9054ca3 None None] Enqueued Resource ID: f7a34583-d054-4050-9626-11d7e79d2ab6 with Priority: HIGHEST for action port [ 589.564845] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a34583-d054-4050-9626-11d7e79d2ab6 with Priority: HIGHEST for action port [ 589.568609] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7a34583-d054-4050-9626-11d7e79d2ab6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.568609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7a34583-d054-4050-9626-11d7e79d2ab6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.568609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7a34583-d054-4050-9626-11d7e79d2ab6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.568609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7a34583-d054-4050-9626-11d7e79d2ab6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.568609] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7a34583-d054-4050-9626-11d7e79d2ab6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.928380] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 842e410d-6a7d-46d4-b27d-b2270b0182e1 [ 589.928601] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.928751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.928820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.929063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.929156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.929247] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:842e410d-6a7d-46d4-b27d-b2270b0182e1 already deleted. [ 589.929326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-842e410d-6a7d-46d4-b27d-b2270b0182e1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.071404] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7a34583-d054-4050-9626-11d7e79d2ab6 [ 590.071625] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.071758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.071831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.072055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.072173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.072236] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7a34583-d054-4050-9626-11d7e79d2ab6 already deleted. [ 590.072319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7a34583-d054-4050-9626-11d7e79d2ab6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.422129] env[69692]: INFO networking_nsxv3.common.synchronization [None req-e3f0db34-86e4-4df2-bd7b-0d5270ee514b None None] Enqueued Resource ID: 3a14dc2f-4aa7-4e53-86e8-42c5ffffbd2b with Priority: HIGHEST for action port [ 590.422370] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a14dc2f-4aa7-4e53-86e8-42c5ffffbd2b with Priority: HIGHEST for action port [ 590.423250] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a14dc2f-4aa7-4e53-86e8-42c5ffffbd2b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.423417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a14dc2f-4aa7-4e53-86e8-42c5ffffbd2b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.423468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a14dc2f-4aa7-4e53-86e8-42c5ffffbd2b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.423816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a14dc2f-4aa7-4e53-86e8-42c5ffffbd2b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.423816] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a14dc2f-4aa7-4e53-86e8-42c5ffffbd2b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.927221] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a14dc2f-4aa7-4e53-86e8-42c5ffffbd2b [ 590.927221] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.927494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.927658] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.928075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.928220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.928401] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a14dc2f-4aa7-4e53-86e8-42c5ffffbd2b already deleted. [ 590.928526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a14dc2f-4aa7-4e53-86e8-42c5ffffbd2b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.033899] env[69692]: INFO networking_nsxv3.common.synchronization [None req-da7e12fd-a1ec-4527-9fee-14ae1be155ad None None] Enqueued Resource ID: a15b971a-b7a7-4bfb-8281-411694c986ab with Priority: HIGHEST for action port [ 591.034836] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15b971a-b7a7-4bfb-8281-411694c986ab with Priority: HIGHEST for action port [ 591.035546] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-a15b971a-b7a7-4bfb-8281-411694c986ab taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.035702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a15b971a-b7a7-4bfb-8281-411694c986ab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.035959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a15b971a-b7a7-4bfb-8281-411694c986ab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.036284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a15b971a-b7a7-4bfb-8281-411694c986ab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.036879] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a15b971a-b7a7-4bfb-8281-411694c986ab',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.541099] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a15b971a-b7a7-4bfb-8281-411694c986ab [ 591.541099] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.541099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.541099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.541099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.541099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.541099] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a15b971a-b7a7-4bfb-8281-411694c986ab already deleted. [ 591.541099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a15b971a-b7a7-4bfb-8281-411694c986ab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.635045] env[69692]: INFO networking_nsxv3.common.synchronization [None req-a778a58e-fda7-4359-9227-091ea6c9a1a7 None None] Enqueued Resource ID: 7be48431-3559-4a16-8a60-6a49b208777c with Priority: HIGHEST for action port [ 591.635216] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7be48431-3559-4a16-8a60-6a49b208777c with Priority: HIGHEST for action port [ 591.638273] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-7be48431-3559-4a16-8a60-6a49b208777c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.638273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7be48431-3559-4a16-8a60-6a49b208777c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.638273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7be48431-3559-4a16-8a60-6a49b208777c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.638273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7be48431-3559-4a16-8a60-6a49b208777c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.638273] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7be48431-3559-4a16-8a60-6a49b208777c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.901241] env[69692]: INFO networking_nsxv3.common.synchronization [None req-bdde59e8-46b3-4419-aeb4-005959533b22 None None] Enqueued Resource ID: f64fe506-f475-48b3-9282-f4f88f0edff2 with Priority: HIGHEST for action port [ 591.901503] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f64fe506-f475-48b3-9282-f4f88f0edff2 with Priority: HIGHEST for action port [ 591.902082] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-f64fe506-f475-48b3-9282-f4f88f0edff2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.902230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f64fe506-f475-48b3-9282-f4f88f0edff2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.902295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f64fe506-f475-48b3-9282-f4f88f0edff2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.902518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f64fe506-f475-48b3-9282-f4f88f0edff2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.902600] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f64fe506-f475-48b3-9282-f4f88f0edff2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.138633] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7be48431-3559-4a16-8a60-6a49b208777c [ 592.138903] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.139615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.139615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.139615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.139615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.139615] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7be48431-3559-4a16-8a60-6a49b208777c already deleted. [ 592.139615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7be48431-3559-4a16-8a60-6a49b208777c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.406893] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f64fe506-f475-48b3-9282-f4f88f0edff2 [ 592.407384] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.407696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.407816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.408047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.408095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.408210] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f64fe506-f475-48b3-9282-f4f88f0edff2 already deleted. [ 592.408303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f64fe506-f475-48b3-9282-f4f88f0edff2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.783413] env[69692]: INFO networking_nsxv3.common.synchronization [req-21a761a6-6f19-4b46-98b6-1037c25a7e88 req-d598ea05-833c-4d9d-b3da-2fcaa8c9e93a tempest-FloatingIPsAssociationTestJSON-220159259 tempest-FloatingIPsAssociationTestJSON-220159259-project-member] Enqueued Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_members [ 592.783961] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_members [ 592.784111] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.784228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.784292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.784544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.784692] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.784786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.784846] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.787329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.788232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.788232] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.219125] env[69692]: INFO networking_nsxv3.common.synchronization [None req-624298b1-3816-4342-8d28-0e4522266d6e tempest-VolumesAdminNegativeTest-1078272547 tempest-VolumesAdminNegativeTest-1078272547-project-member] Enqueued Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGHEST for action security_group_rules [ 593.219754] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGHEST for action security_group_rules [ 593.221273] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0606438c-ea63-4fae-97b5-53d1cd997a59 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.221273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.221273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.221273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.221273] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.289716] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.289866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.289977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.290229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.290331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.290544] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.290659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.290722] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.290927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.290960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.291066] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 already deleted. [ 593.291153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.346832] env[69692]: INFO networking_nsxv3.common.synchronization [None req-7e1e0134-0670-4dde-920e-1382413bb040 None None] Enqueued Resource ID: 3ff20c5b-70b5-4b54-9471-56fc2d9c351b with Priority: HIGHEST for action port [ 593.347122] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ff20c5b-70b5-4b54-9471-56fc2d9c351b with Priority: HIGHEST for action port [ 593.347734] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ff20c5b-70b5-4b54-9471-56fc2d9c351b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.347865] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ff20c5b-70b5-4b54-9471-56fc2d9c351b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.348329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ff20c5b-70b5-4b54-9471-56fc2d9c351b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.348329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ff20c5b-70b5-4b54-9471-56fc2d9c351b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.348329] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ff20c5b-70b5-4b54-9471-56fc2d9c351b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.443262] env[69692]: INFO networking_nsxv3.common.synchronization [None req-7f8583c5-684d-469a-a2b5-5c2b3b8da668 tempest-VolumesAdminNegativeTest-1078272547 tempest-VolumesAdminNegativeTest-1078272547-project-member] Enqueued Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGHEST for action security_group_rules [ 593.447043] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGHEST for action security_group_rules [ 593.447043] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0606438c-ea63-4fae-97b5-53d1cd997a59 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.447043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.743272] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.743272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.743272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.743443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.743524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.743616] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 already deleted. [ 593.743700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.743842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.743990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.744082] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.853269] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ff20c5b-70b5-4b54-9471-56fc2d9c351b [ 593.853269] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.853269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.853269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.853269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.853269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.853269] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ff20c5b-70b5-4b54-9471-56fc2d9c351b already deleted. [ 593.853269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ff20c5b-70b5-4b54-9471-56fc2d9c351b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.048522] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-393 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.048706] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-393" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.048833] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-393" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.049158] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-393" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.049475] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.049603] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.050450] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.050450] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.052193] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.052519] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 594.052646] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.052762] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.052879] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.052993] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 594.053121] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.053259] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.071776] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.072347] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 594.072347] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.072347] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-393" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.072631] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-73f5d294-7953-48bc-9257-bba950e41446 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.076041] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-73f5d294-7953-48bc-9257-bba950e41446" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.076265] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-73f5d294-7953-48bc-9257-bba950e41446" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.076604] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-73f5d294-7953-48bc-9257-bba950e41446" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.076869] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f5d294-7953-48bc-9257-bba950e41446',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.265628] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.265770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.265770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.266244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.266244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.266244] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 already deleted. [ 594.268476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.381854] env[69692]: INFO networking_nsxv3.common.synchronization [None req-53fa7030-2b41-40a9-a3ff-3a99f10a70ef tempest-VolumesAssistedSnapshotsTest-1274009765 tempest-VolumesAssistedSnapshotsTest-1274009765-project-member] Enqueued Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGHEST for action security_group_rules [ 594.382377] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGHEST for action security_group_rules [ 594.382793] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d4ca52d-d178-4c04-a293-073162c8fb0b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.382793] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.382955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.383427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.383427] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d4ca52d-d178-4c04-a293-073162c8fb0b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.543228] env[69692]: INFO networking_nsxv3.common.synchronization [None req-b89de365-c982-447a-a6e9-5e474e8a8643 tempest-VolumesAssistedSnapshotsTest-1274009765 tempest-VolumesAssistedSnapshotsTest-1274009765-project-member] Enqueued Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGHEST for action security_group_rules [ 594.543228] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGHEST for action security_group_rules [ 594.543228] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d4ca52d-d178-4c04-a293-073162c8fb0b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.543228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.579696] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.581237] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.581639] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.581852] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.582098] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.582355] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 73f5d294-7953-48bc-9257-bba950e41446 not found, creating... [ 594.582641] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.582887] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.583019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.583419] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.583473] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.583998] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.583998] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.584258] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.584368] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.585956] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.585956] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 73f5d294-7953-48bc-9257-bba950e41446 is going to be created. [ 594.590107] env[69692]: INFO networking_nsxv3.common.synchronization [None req-192aebf7-0ee6-4cbd-95fa-3624c4bd454a tempest-ServersTestJSON-1710059859 tempest-ServersTestJSON-1710059859-project-member] Enqueued Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGHEST for action security_group_rules [ 594.590348] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGHEST for action security_group_rules [ 594.590879] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9ea5c0-4781-4575-9fde-6a93632303e0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.591012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.591078] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.591283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.591392] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9ea5c0-4781-4575-9fde-6a93632303e0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.611352] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.611352] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.611352] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.611352] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.611352] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.611352] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-73f5d294-7953-48bc-9257-bba950e41446" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.693532] env[69692]: INFO networking_nsxv3.common.synchronization [None req-6b202eeb-29b1-4bd1-b75a-b6e38125d60a tempest-ServersTestJSON-1710059859 tempest-ServersTestJSON-1710059859-project-member] Enqueued Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGHEST for action security_group_rules [ 594.694062] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGHEST for action security_group_rules [ 594.694375] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9ea5c0-4781-4575-9fde-6a93632303e0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.694479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.912837] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.912837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.912837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.912837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.912837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.912837] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b already deleted. [ 594.912837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.912837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.912837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.912837] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d4ca52d-d178-4c04-a293-073162c8fb0b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.111993] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.112157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.112261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.112470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.112583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.112819] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 already deleted. [ 595.112819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.113018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.113075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.113161] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9ea5c0-4781-4575-9fde-6a93632303e0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.320968] env[69692]: INFO networking_nsxv3.common.synchronization [req-100cab63-d67b-43c6-9a8e-a88b56d830c2 req-f8ec7165-636c-4f7f-a60f-974de415b71a tempest-DeleteServersAdminTestJSON-1110711245 tempest-DeleteServersAdminTestJSON-1110711245-project-member] Enqueued Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_members [ 595.321197] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_members [ 595.321373] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.321489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.321555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.321973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.322197] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.322312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.322377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.322543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.322693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.323287] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.433324] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.433530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.433866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.434127] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.434245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.434367] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b already deleted. [ 595.434464] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.638216] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.638216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.638216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.638216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.638216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.638216] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 already deleted. [ 595.638216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.737240] env[69692]: INFO networking_nsxv3.common.synchronization [req-21a761a6-6f19-4b46-98b6-1037c25a7e88 req-60717313-f259-4ec8-a3b6-bae49ecf1db1 service nova] Enqueued Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_rules [ 595.737240] env[69692]: INFO networking_nsxv3.common.synchronization [req-21a761a6-6f19-4b46-98b6-1037c25a7e88 req-60717313-f259-4ec8-a3b6-bae49ecf1db1 service nova] Enqueued Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_members [ 595.737240] env[69692]: INFO networking_nsxv3.common.synchronization [req-21a761a6-6f19-4b46-98b6-1037c25a7e88 req-60717313-f259-4ec8-a3b6-bae49ecf1db1 service nova] Enqueued Resource ID: 73f5d294-7953-48bc-9257-bba950e41446 with Priority: HIGHEST for action port [ 595.737240] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_rules [ 595.737240] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_members [ 595.737240] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f5d294-7953-48bc-9257-bba950e41446 with Priority: HIGHEST for action port [ 595.737240] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.737754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.737920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.738255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.738504] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.741207] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.741491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.741869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.741869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.742936] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.742936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.742936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.742936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.742936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.742936] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.744834] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-73f5d294-7953-48bc-9257-bba950e41446 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.744834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73f5d294-7953-48bc-9257-bba950e41446" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.744834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73f5d294-7953-48bc-9257-bba950e41446" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.744834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73f5d294-7953-48bc-9257-bba950e41446" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.744834] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f5d294-7953-48bc-9257-bba950e41446',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.827586] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.827586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.827586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.827586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.827586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.827586] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.827586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.827586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.827586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.827586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.827586] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb already deleted. [ 595.827586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.977518] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.977788] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.977878] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.978187] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.978451] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.978663] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.978711] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.978952] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.981287] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.981540] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.982156] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.982156] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.982156] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.982156] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.982156] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.982479] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 596.000243] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 596.000406] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 596.000544] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 596.000719] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.001066] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.001283] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.001405] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.001728] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.002016] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.247162] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.247737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.256808] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.258872] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73f5d294-7953-48bc-9257-bba950e41446 with status ACTIVE [ 596.258872] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.258872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.258872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.258872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.258872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.258872] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.258872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.258872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.258872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.259316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.259316] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.259316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.259316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.259457] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.259457] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.259564] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73f5d294-7953-48bc-9257-bba950e41446 is going to be updated. [ 596.284088] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.284088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.284088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.284088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.284088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.284281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73f5d294-7953-48bc-9257-bba950e41446" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.505530] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.505752] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.505942] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.506209] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.506334] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.506481] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd not found, creating... [ 596.510537] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.510537] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.510537] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.510537] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.510537] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.510537] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.510537] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.510537] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.511378] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.511378] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.511378] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd is going to be created. [ 596.535628] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.536154] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.536154] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.536287] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.536504] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.536727] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.763466] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.266824] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.267807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.268065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.268729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.269340] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.269559] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 is going to be created. [ 597.301133] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.301133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.301133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.301133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.301133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.308935] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: UNINITIALIZED for 2s [ 597.405203] env[69692]: INFO networking_nsxv3.common.synchronization [None req-1b8af4dd-2de4-4506-bad0-93dba68298ad None None] Enqueued Resource ID: c794e20a-e5f8-4d63-b8c2-016044aceb9c with Priority: HIGHEST for action port [ 597.406929] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c794e20a-e5f8-4d63-b8c2-016044aceb9c with Priority: HIGHEST for action port [ 597.406929] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-c794e20a-e5f8-4d63-b8c2-016044aceb9c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.406929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c794e20a-e5f8-4d63-b8c2-016044aceb9c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.406929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c794e20a-e5f8-4d63-b8c2-016044aceb9c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.406929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c794e20a-e5f8-4d63-b8c2-016044aceb9c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.406929] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c794e20a-e5f8-4d63-b8c2-016044aceb9c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.653300] env[69692]: INFO networking_nsxv3.common.synchronization [req-4194442c-c76a-45cd-88ed-062520a4cc2e req-67bd06d6-8d1a-4453-8a7c-49458f7d50b9 tempest-TenantUsagesTestJSON-132239226 tempest-TenantUsagesTestJSON-132239226-project-member] Enqueued Resource ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f with Priority: HIGHEST for action security_group_members [ 597.653300] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f with Priority: HIGHEST for action security_group_members [ 597.653300] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.653300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.653575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.653575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.657802] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.657802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.657802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.657802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.657802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.657802] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb8b39ac-23d5-452c-9ec6-33c3aa98d53f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.787518] env[69692]: INFO networking_nsxv3.common.synchronization [req-100cab63-d67b-43c6-9a8e-a88b56d830c2 req-86830018-20d3-4b69-b20f-ef1b1b1fa6fe service nova] Enqueued Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_rules [ 597.787518] env[69692]: INFO networking_nsxv3.common.synchronization [req-100cab63-d67b-43c6-9a8e-a88b56d830c2 req-86830018-20d3-4b69-b20f-ef1b1b1fa6fe service nova] Enqueued Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_members [ 597.787518] env[69692]: INFO networking_nsxv3.common.synchronization [req-100cab63-d67b-43c6-9a8e-a88b56d830c2 req-86830018-20d3-4b69-b20f-ef1b1b1fa6fe service nova] Enqueued Resource ID: 7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd with Priority: HIGHEST for action port [ 597.788179] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_rules [ 597.788179] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_members [ 597.788179] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd with Priority: HIGHEST for action port [ 597.788784] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.788784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.788784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.788963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.789296] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.790676] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.792890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.792890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.792890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.792890] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.792890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.792890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.792890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.792890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.792890] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.792890] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.792890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.792890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.792890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.792890] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.801683] env[69692]: INFO networking_nsxv3.common.synchronization [None req-6168b53c-7ad3-4519-aab6-01e11c149b96 None None] Enqueued Resource ID: 382059ad-cea4-4acf-9754-bcc89eb94b61 with Priority: HIGHEST for action port [ 597.801811] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 382059ad-cea4-4acf-9754-bcc89eb94b61 with Priority: HIGHEST for action port [ 597.802946] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-382059ad-cea4-4acf-9754-bcc89eb94b61 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.803076] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-382059ad-cea4-4acf-9754-bcc89eb94b61" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.803245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-382059ad-cea4-4acf-9754-bcc89eb94b61" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.803372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-382059ad-cea4-4acf-9754-bcc89eb94b61" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.803448] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('382059ad-cea4-4acf-9754-bcc89eb94b61',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.909816] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c794e20a-e5f8-4d63-b8c2-016044aceb9c [ 597.910082] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.912261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.912434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.912579] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.912686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.912793] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c794e20a-e5f8-4d63-b8c2-016044aceb9c already deleted. [ 597.912881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c794e20a-e5f8-4d63-b8c2-016044aceb9c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.082708] env[69692]: INFO networking_nsxv3.common.synchronization [None req-c16eeb41-72e0-463d-acdd-5355b427cb09 None None] Enqueued Resource ID: 4f361a75-3197-40ae-87dc-c610ab7ac3ad with Priority: HIGHEST for action port [ 598.082708] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f361a75-3197-40ae-87dc-c610ab7ac3ad with Priority: HIGHEST for action port [ 598.082708] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f361a75-3197-40ae-87dc-c610ab7ac3ad taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.082708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f361a75-3197-40ae-87dc-c610ab7ac3ad" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.082708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f361a75-3197-40ae-87dc-c610ab7ac3ad" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.082708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f361a75-3197-40ae-87dc-c610ab7ac3ad" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.082708] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f361a75-3197-40ae-87dc-c610ab7ac3ad',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.099596] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.099804] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.099929] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.100257] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.100495] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.100653] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.100769] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.100986] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.104544] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.104544] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 598.104705] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.104781] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.104973] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.105050] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 598.106238] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.106414] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.127679] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.127845] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 598.128073] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.128178] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.132235] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-1c6e040e-d028-47ce-99ab-e9a4282de967 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.132235] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-1c6e040e-d028-47ce-99ab-e9a4282de967" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.132235] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-1c6e040e-d028-47ce-99ab-e9a4282de967" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.132235] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-1c6e040e-d028-47ce-99ab-e9a4282de967" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.132235] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c6e040e-d028-47ce-99ab-e9a4282de967',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.156711] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.157791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.157791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.157791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.157791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.157791] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.157791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.157791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.158178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.158178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.158178] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f already deleted. [ 598.158305] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.297461] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.297461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.297461] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.297461] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd with status ACTIVE [ 598.297461] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.297461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.297461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.297461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.297461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.297461] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.298053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.298053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.298053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.304903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.304903] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.304903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.304903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.304903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.305188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.305188] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd is going to be updated. [ 598.312757] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 382059ad-cea4-4acf-9754-bcc89eb94b61 [ 598.312970] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.313392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.313457] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.316343] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.316343] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.316413] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:382059ad-cea4-4acf-9754-bcc89eb94b61 already deleted. [ 598.316484] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-382059ad-cea4-4acf-9754-bcc89eb94b61" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.328063] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.328063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.328063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.328063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.328063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.328063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7daf3b6b-6eba-4936-b5d3-64b0bf8eadfd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.431216] env[69692]: INFO networking_nsxv3.common.synchronization [None req-4d228fe2-4c13-4dbc-a62d-1a4f88650a0b None None] Enqueued Resource ID: 59775365-9d6a-4fda-8e64-377e62a8758b with Priority: HIGHEST for action port [ 598.431485] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59775365-9d6a-4fda-8e64-377e62a8758b with Priority: HIGHEST for action port [ 598.433938] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-59775365-9d6a-4fda-8e64-377e62a8758b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.434082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59775365-9d6a-4fda-8e64-377e62a8758b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.435361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59775365-9d6a-4fda-8e64-377e62a8758b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.435676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59775365-9d6a-4fda-8e64-377e62a8758b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.435767] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59775365-9d6a-4fda-8e64-377e62a8758b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.587480] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f361a75-3197-40ae-87dc-c610ab7ac3ad [ 598.587480] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.587480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.587480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.587480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.587480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.587480] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f361a75-3197-40ae-87dc-c610ab7ac3ad already deleted. [ 598.587480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f361a75-3197-40ae-87dc-c610ab7ac3ad" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.635026] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.636558] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.636558] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.636558] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.636558] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.636558] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 1c6e040e-d028-47ce-99ab-e9a4282de967 not found, creating... [ 598.636999] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.636999] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.637140] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.637646] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.637646] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.637825] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.638033] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.638719] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.638719] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.638719] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.638877] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 1c6e040e-d028-47ce-99ab-e9a4282de967 is going to be created. [ 598.663664] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.663908] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.664053] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.664378] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.665815] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.665815] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-1c6e040e-d028-47ce-99ab-e9a4282de967" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.807367] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.938502] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59775365-9d6a-4fda-8e64-377e62a8758b [ 598.938502] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.938502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.938502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.938697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.938728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.938906] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59775365-9d6a-4fda-8e64-377e62a8758b already deleted. [ 598.938906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59775365-9d6a-4fda-8e64-377e62a8758b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.312109] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.312585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.312585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.312585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.312740] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.312772] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb is going to be created. [ 599.335760] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: SUCCESS [ 599.335760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.335760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.336041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.336253] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.336401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.336492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.337407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.337407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.337407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.337407] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.346847] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.346847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.346847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.346847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.346847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.355081] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: UNINITIALIZED for 2s [ 599.722418] env[69692]: INFO networking_nsxv3.common.synchronization [req-4194442c-c76a-45cd-88ed-062520a4cc2e req-91f42302-363c-4bc4-a8f5-6a741c6c72b7 service nova] Enqueued Resource ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f with Priority: HIGHEST for action security_group_rules [ 599.722418] env[69692]: INFO networking_nsxv3.common.synchronization [req-4194442c-c76a-45cd-88ed-062520a4cc2e req-91f42302-363c-4bc4-a8f5-6a741c6c72b7 service nova] Enqueued Resource ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f with Priority: HIGHEST for action security_group_members [ 599.722418] env[69692]: INFO networking_nsxv3.common.synchronization [req-4194442c-c76a-45cd-88ed-062520a4cc2e req-91f42302-363c-4bc4-a8f5-6a741c6c72b7 service nova] Enqueued Resource ID: 1c6e040e-d028-47ce-99ab-e9a4282de967 with Priority: HIGHEST for action port [ 599.722418] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f with Priority: HIGHEST for action security_group_rules [ 599.722418] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f with Priority: HIGHEST for action security_group_members [ 599.722418] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c6e040e-d028-47ce-99ab-e9a4282de967 with Priority: HIGHEST for action port [ 599.722418] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.722418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.722418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.722418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.722418] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb8b39ac-23d5-452c-9ec6-33c3aa98d53f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.724288] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.724456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.724527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.724715] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.724913] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.725048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.725120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.725273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.725356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.725443] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb8b39ac-23d5-452c-9ec6-33c3aa98d53f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.728067] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c6e040e-d028-47ce-99ab-e9a4282de967 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.728270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c6e040e-d028-47ce-99ab-e9a4282de967" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.728270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c6e040e-d028-47ce-99ab-e9a4282de967" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.732036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c6e040e-d028-47ce-99ab-e9a4282de967" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.732036] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c6e040e-d028-47ce-99ab-e9a4282de967',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.821997] env[69692]: INFO networking_nsxv3.common.synchronization [req-df457497-0635-4e86-a56d-a0838a88f527 req-1946db49-dcc9-468d-b96e-13a4f54a8bbf tempest-ServerDiagnosticsTest-2133587746 tempest-ServerDiagnosticsTest-2133587746-project-member] Enqueued Resource ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 with Priority: HIGHEST for action security_group_members [ 599.822507] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 with Priority: HIGHEST for action security_group_members [ 599.827124] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18ef3ce-d814-4cfb-b497-dbf659cd1988 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.827124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.827124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.827124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.828538] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.828684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.829408] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.829530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.829617] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.829712] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18ef3ce-d814-4cfb-b497-dbf659cd1988',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.842426] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.843288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.843288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.843288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.843288] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.843288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.843288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.843800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.843800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.843800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.843800] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.843800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.843800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.843997] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.844127] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.844602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.844602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.844602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.844602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.844602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.844857] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.220319] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.220564] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.220728] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.221073] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.221368] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.221570] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.221707] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.222131] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.222131] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.222469] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 600.222469] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.222593] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.222690] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.222799] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 600.222922] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.223107] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.227706] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb8b39ac-23d5-452c-9ec6-33c3aa98d53f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.230050] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.233282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.233282] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c6e040e-d028-47ce-99ab-e9a4282de967 with status ACTIVE [ 600.233282] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.233282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.233282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.233282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.233282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.233557] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.233557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.233557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.233742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.233773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.233975] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.234089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.234149] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.234291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.234389] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.235854] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c6e040e-d028-47ce-99ab-e9a4282de967 is going to be updated. [ 600.253806] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.253995] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 600.254244] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.254346] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.254651] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-a3c6032f-bd19-470b-83c6-999c80d1fe60 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.254816] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-a3c6032f-bd19-470b-83c6-999c80d1fe60" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.254972] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-a3c6032f-bd19-470b-83c6-999c80d1fe60" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.255337] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-a3c6032f-bd19-470b-83c6-999c80d1fe60" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.255444] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3c6032f-bd19-470b-83c6-999c80d1fe60',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.266738] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.266866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.266944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.267172] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.267317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.267472] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c6e040e-d028-47ce-99ab-e9a4282de967" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.334504] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.334876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.334876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.335257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.335521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.335812] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.336175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.336534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.336678] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.336910] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.336910] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 already deleted. [ 600.337022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.347895] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 559d2715-9b43-4a1c-ab57-3faf644a7a85: rpc.has_security_group_logging(os_id): False [ 600.376126] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.376126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.376126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.376126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.376126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.376126] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.376126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.376126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.376126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.376126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.376126] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.376126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.376126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.376126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.376126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.378326] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.378326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.378326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.378326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.378326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.378617] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 is going to be created. [ 600.454123] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.454745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.454826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.455929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.455929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.468973] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: IN_PROGRESS for 2s [ 600.741775] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb8b39ac-23d5-452c-9ec6-33c3aa98d53f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.759360] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.759731] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.760211] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.760430] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.760668] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.760904] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port a3c6032f-bd19-470b-83c6-999c80d1fe60 not found, creating... [ 600.761475] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.761475] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.761663] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.761896] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.762156] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.762490] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.762719] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.762875] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.763148] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.763315] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.763481] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: a3c6032f-bd19-470b-83c6-999c80d1fe60 is going to be created. [ 600.784028] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.785897] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.785897] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.785897] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.785897] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.785897] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-a3c6032f-bd19-470b-83c6-999c80d1fe60" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.237925] env[69692]: INFO networking_nsxv3.common.synchronization [None req-de1417bb-f3e3-4673-aa62-f12ae375f517 tempest-ServersWithSpecificFlavorTestJSON-467341840 tempest-ServersWithSpecificFlavorTestJSON-467341840-project-member] Enqueued Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_rules [ 601.239705] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_rules [ 601.239866] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.240513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.240513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.240513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.240513] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.243346] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.243702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.243702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.243765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.243824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.243918] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f is going to be created. [ 601.266597] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.266962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.268690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.268690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.268690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.276395] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f in Status: UNINITIALIZED for 2s [ 601.360500] env[69692]: INFO networking_nsxv3.common.synchronization [None req-cd61c3fd-bdeb-4e6b-b221-5f3bc505f188 tempest-ServersWithSpecificFlavorTestJSON-467341840 tempest-ServersWithSpecificFlavorTestJSON-467341840-project-member] Enqueued Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_rules [ 601.361521] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_rules [ 601.361848] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.361958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.368182] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: SUCCESS [ 601.368318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.368749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.368955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.369383] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.369383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.369383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.369531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.369531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.369608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.369693] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.555019] env[69692]: INFO networking_nsxv3.common.synchronization [req-df457497-0635-4e86-a56d-a0838a88f527 req-cd1c4f99-c85f-457e-ae09-c87ac80921c9 service nova] Enqueued Resource ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 with Priority: HIGHEST for action security_group_rules [ 601.555019] env[69692]: INFO networking_nsxv3.common.synchronization [req-df457497-0635-4e86-a56d-a0838a88f527 req-cd1c4f99-c85f-457e-ae09-c87ac80921c9 service nova] Enqueued Resource ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 with Priority: HIGHEST for action security_group_members [ 601.555019] env[69692]: INFO networking_nsxv3.common.synchronization [req-df457497-0635-4e86-a56d-a0838a88f527 req-cd1c4f99-c85f-457e-ae09-c87ac80921c9 service nova] Enqueued Resource ID: a3c6032f-bd19-470b-83c6-999c80d1fe60 with Priority: HIGHEST for action port [ 601.555019] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 with Priority: HIGHEST for action security_group_rules [ 601.555019] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 with Priority: HIGHEST for action security_group_members [ 601.555019] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3c6032f-bd19-470b-83c6-999c80d1fe60 with Priority: HIGHEST for action port [ 601.558886] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a18ef3ce-d814-4cfb-b497-dbf659cd1988 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.558886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.558886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.558886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.558886] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a18ef3ce-d814-4cfb-b497-dbf659cd1988',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.558886] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18ef3ce-d814-4cfb-b497-dbf659cd1988 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.558886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.558886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.558886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.558886] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.558886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.558886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.558886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.558886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.558886] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18ef3ce-d814-4cfb-b497-dbf659cd1988',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.558886] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3c6032f-bd19-470b-83c6-999c80d1fe60 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.559751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3c6032f-bd19-470b-83c6-999c80d1fe60" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.562798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3c6032f-bd19-470b-83c6-999c80d1fe60" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.562798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3c6032f-bd19-470b-83c6-999c80d1fe60" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.562798] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3c6032f-bd19-470b-83c6-999c80d1fe60',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.760268] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.760437] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.760523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.760739] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.760849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.760961] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 already deleted. [ 601.761084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.761244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.761401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.761489] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.874047] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.874254] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.874363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.874630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.874842] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.874972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.875092] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.876195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.876195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.876195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.876195] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.876195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.876195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.876195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.876195] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.876195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.876945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.876945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.876945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.876945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.877074] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.064393] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a18ef3ce-d814-4cfb-b497-dbf659cd1988',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.066940] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18ef3ce-d814-4cfb-b497-dbf659cd1988 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.066940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.069393] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3c6032f-bd19-470b-83c6-999c80d1fe60 with status ACTIVE [ 602.069647] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.069765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.069765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.070521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.070521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.070521] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.070521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.070521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.072247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.072247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.072247] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.072247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.072247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.072247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.072247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.072247] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3c6032f-bd19-470b-83c6-999c80d1fe60 is going to be updated. [ 602.092590] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.092590] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.092590] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.092590] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.092590] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.092590] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3c6032f-bd19-470b-83c6-999c80d1fe60" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.281841] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.281999] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.285214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.285505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.285566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.285665] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 already deleted. [ 602.285784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.380401] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb: rpc.has_security_group_logging(os_id): False [ 602.398177] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.398325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.398394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.398620] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.398711] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.398920] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.399039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.399105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.399269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.399352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.399543] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.399633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.399698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.399844] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.399927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.401755] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.401755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.401755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.401755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.401755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.401755] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb is going to be created. [ 602.459025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.459587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.459683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.459953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.460228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.471295] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: IN_PROGRESS for 2s [ 602.479377] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: SUCCESS [ 602.479517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.570028] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a18ef3ce-d814-4cfb-b497-dbf659cd1988',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.072245] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.072396] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.072458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.072753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.072753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.072869] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 is going to be created. [ 603.098609] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.098609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.098609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.098609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.098609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.107154] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 in Status: UNINITIALIZED for 2s [ 603.290147] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f in Status: SUCCESS [ 603.291707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.291707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.291707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.291707] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.291707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.291707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.291707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.292311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.292311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.292311] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb8b39ac-23d5-452c-9ec6-33c3aa98d53f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.800134] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.800134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.800134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.800134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.800134] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.800134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.800134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.800134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.800134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.800134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.800134] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.800134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.800134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.800134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.800134] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.800134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.800993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.800993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.800993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.800993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.800993] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb8b39ac-23d5-452c-9ec6-33c3aa98d53f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.304385] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb8b39ac-23d5-452c-9ec6-33c3aa98d53f: rpc.has_security_group_logging(os_id): False [ 604.322747] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.322747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.322747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.322747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.322747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.323043] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.327020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.327020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.327020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.327020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.327020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.327020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.327020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.327020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.327020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.327020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.327020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.327799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.327799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.327799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.327799] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f is going to be created. [ 604.384409] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.384409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.384409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.384409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.384409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.401319] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f in Status: IN_PROGRESS for 2s [ 604.485921] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: SUCCESS [ 604.486345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.803099] env[69692]: INFO networking_nsxv3.common.synchronization [req-40dc3e96-dc68-42b0-9467-62970b855eb2 req-bed08224-3285-4252-9663-95e3b634f056 tempest-FloatingIPsAssociationNegativeTestJSON-1148568605 tempest-FloatingIPsAssociationNegativeTestJSON-1148568605-project-member] Enqueued Resource ID: beac83ef-5694-434f-9cdc-fd976212be41 with Priority: HIGHEST for action security_group_members [ 604.803099] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beac83ef-5694-434f-9cdc-fd976212be41 with Priority: HIGHEST for action security_group_members [ 604.803099] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-beac83ef-5694-434f-9cdc-fd976212be41 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.803629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.803629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.803629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.803719] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.807025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.807025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.807025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.807025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.807025] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beac83ef-5694-434f-9cdc-fd976212be41',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.079532] env[69692]: INFO networking_nsxv3.common.synchronization [None req-750f72d2-a446-45cb-8bfb-13af759ae057 None None] Enqueued Resource ID: 334e9049-6f5f-478c-890c-c056f714a18a with Priority: HIGHEST for action port [ 605.080233] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334e9049-6f5f-478c-890c-c056f714a18a with Priority: HIGHEST for action port [ 605.080400] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-334e9049-6f5f-478c-890c-c056f714a18a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.080506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-334e9049-6f5f-478c-890c-c056f714a18a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.080887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-334e9049-6f5f-478c-890c-c056f714a18a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.081163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-334e9049-6f5f-478c-890c-c056f714a18a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.081251] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('334e9049-6f5f-478c-890c-c056f714a18a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.116955] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 in Status: UNINITIALIZED for 4s [ 605.308453] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.308539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.308625] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.309266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.309266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.309266] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.309587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.309587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.309587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.309727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.309727] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beac83ef-5694-434f-9cdc-fd976212be41 already deleted. [ 605.309817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.461260] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-884 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.461260] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-884" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.461372] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-884" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.462395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-884" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.462395] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.462395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.462395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.462630] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.462736] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.464428] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 605.464428] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.464428] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.464428] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.464428] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 605.464428] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.464428] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.483155] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.483155] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 605.483155] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.483155] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-884" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.483155] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-cc0e8808-038e-4c32-b54d-ab1c98caabf5 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.483424] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-cc0e8808-038e-4c32-b54d-ab1c98caabf5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.483424] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-cc0e8808-038e-4c32-b54d-ab1c98caabf5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.483643] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-cc0e8808-038e-4c32-b54d-ab1c98caabf5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.483774] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc0e8808-038e-4c32-b54d-ab1c98caabf5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.583916] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 334e9049-6f5f-478c-890c-c056f714a18a [ 605.584246] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.584459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.584663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.584879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.584879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.584996] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:334e9049-6f5f-478c-890c-c056f714a18a already deleted. [ 605.585106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-334e9049-6f5f-478c-890c-c056f714a18a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.987901] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.988414] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.988414] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.988671] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.988771] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.988976] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port cc0e8808-038e-4c32-b54d-ab1c98caabf5 not found, creating... [ 605.989331] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.989563] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.989698] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.989927] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.990112] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.991936] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.992152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.992152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.992401] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.992540] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.992690] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: cc0e8808-038e-4c32-b54d-ab1c98caabf5 is going to be created. [ 606.020327] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.020327] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.020327] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.020327] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.020327] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.020327] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-cc0e8808-038e-4c32-b54d-ab1c98caabf5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.095743] env[69692]: INFO networking_nsxv3.common.synchronization [None req-d929f6ba-0349-489f-abab-0f7bd34a909d None None] Enqueued Resource ID: 7aabf23f-835e-4132-b086-f2c435ecd52d with Priority: HIGHEST for action port [ 606.098794] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aabf23f-835e-4132-b086-f2c435ecd52d with Priority: HIGHEST for action port [ 606.099098] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-7aabf23f-835e-4132-b086-f2c435ecd52d taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.099216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7aabf23f-835e-4132-b086-f2c435ecd52d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.099270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7aabf23f-835e-4132-b086-f2c435ecd52d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.100162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7aabf23f-835e-4132-b086-f2c435ecd52d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.100268] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7aabf23f-835e-4132-b086-f2c435ecd52d',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.412603] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f in Status: SUCCESS [ 606.412603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.604586] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7aabf23f-835e-4132-b086-f2c435ecd52d [ 606.607273] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.607273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.607273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.607273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.607273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.607273] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7aabf23f-835e-4132-b086-f2c435ecd52d already deleted. [ 606.607273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7aabf23f-835e-4132-b086-f2c435ecd52d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.002957] env[69692]: INFO networking_nsxv3.common.synchronization [req-3c2e6a5d-39fe-41ee-aa83-080a1672b256 req-edd145e9-8058-4879-aee5-0d61bf5b8873 tempest-AttachInterfacesV270Test-589166570 tempest-AttachInterfacesV270Test-589166570-project-member] Enqueued Resource ID: b57d8773-fb88-48dd-8778-aad060b75558 with Priority: HIGHEST for action security_group_members [ 607.003914] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b57d8773-fb88-48dd-8778-aad060b75558 with Priority: HIGHEST for action security_group_members [ 607.003914] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b57d8773-fb88-48dd-8778-aad060b75558 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.003914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.004197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.006663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.006941] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.007377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.007481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.007662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.007754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.007851] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b57d8773-fb88-48dd-8778-aad060b75558',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.127453] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 in Status: SUCCESS [ 607.128435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.128709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.130236] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.130456] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.131463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.131463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.131463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.131463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.131463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.131463] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a18ef3ce-d814-4cfb-b497-dbf659cd1988',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.471040] env[69692]: INFO networking_nsxv3.common.synchronization [req-40dc3e96-dc68-42b0-9467-62970b855eb2 req-1a6f826d-c468-4809-824b-18f37c93e8da service nova] Enqueued Resource ID: beac83ef-5694-434f-9cdc-fd976212be41 with Priority: HIGHEST for action security_group_rules [ 607.471324] env[69692]: INFO networking_nsxv3.common.synchronization [req-40dc3e96-dc68-42b0-9467-62970b855eb2 req-1a6f826d-c468-4809-824b-18f37c93e8da service nova] Enqueued Resource ID: beac83ef-5694-434f-9cdc-fd976212be41 with Priority: HIGHEST for action security_group_members [ 607.471440] env[69692]: INFO networking_nsxv3.common.synchronization [req-40dc3e96-dc68-42b0-9467-62970b855eb2 req-1a6f826d-c468-4809-824b-18f37c93e8da service nova] Enqueued Resource ID: cc0e8808-038e-4c32-b54d-ab1c98caabf5 with Priority: HIGHEST for action port [ 607.471973] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beac83ef-5694-434f-9cdc-fd976212be41 with Priority: HIGHEST for action security_group_rules [ 607.473124] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beac83ef-5694-434f-9cdc-fd976212be41 with Priority: HIGHEST for action security_group_members [ 607.473314] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0e8808-038e-4c32-b54d-ab1c98caabf5 with Priority: HIGHEST for action port [ 607.473681] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beac83ef-5694-434f-9cdc-fd976212be41 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.473774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.473841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.474121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.474211] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beac83ef-5694-434f-9cdc-fd976212be41',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.480245] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-beac83ef-5694-434f-9cdc-fd976212be41 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.480245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.480245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.480245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.480245] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.480245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.480245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.480729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.480729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.480729] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beac83ef-5694-434f-9cdc-fd976212be41',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.481418] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc0e8808-038e-4c32-b54d-ab1c98caabf5 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.481565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc0e8808-038e-4c32-b54d-ab1c98caabf5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.481624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc0e8808-038e-4c32-b54d-ab1c98caabf5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.481732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc0e8808-038e-4c32-b54d-ab1c98caabf5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.481832] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc0e8808-038e-4c32-b54d-ab1c98caabf5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.510284] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.510284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.510284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.510284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.510450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.510527] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.510624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.510685] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.510831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.510913] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.510993] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b57d8773-fb88-48dd-8778-aad060b75558 already deleted. [ 607.511132] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.635843] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18ef3ce-d814-4cfb-b497-dbf659cd1988 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.636273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.636435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.636831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.637129] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.637357] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.640017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.640017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.640017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.640017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.640017] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18ef3ce-d814-4cfb-b497-dbf659cd1988 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.640017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.640017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.640017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.640017] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.640017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.640017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.640017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.640017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.640017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.640017] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a18ef3ce-d814-4cfb-b497-dbf659cd1988',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.866545] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.866734] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-422" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.866884] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-422" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.867254] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-422" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.867532] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.867778] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.867829] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.868075] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.868219] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.868420] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 607.868541] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.868647] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.868751] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.869198] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 607.869198] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.869198] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.887967] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.888276] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 607.888346] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.889341] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-422" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.889788] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-e5eefd40-96d3-414b-a9bf-84a05537de8d taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.889788] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-e5eefd40-96d3-414b-a9bf-84a05537de8d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.889907] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-e5eefd40-96d3-414b-a9bf-84a05537de8d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.890292] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-e5eefd40-96d3-414b-a9bf-84a05537de8d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.890427] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5eefd40-96d3-414b-a9bf-84a05537de8d',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.983443] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-beac83ef-5694-434f-9cdc-fd976212be41 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.983559] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.984200] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('beac83ef-5694-434f-9cdc-fd976212be41',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.984909] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc0e8808-038e-4c32-b54d-ab1c98caabf5 with status ACTIVE [ 607.985095] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.985206] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.985270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.985580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.985738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.985889] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.985986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.986058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.986220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.986292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.986472] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.986558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.986669] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.986807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.986848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.986928] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc0e8808-038e-4c32-b54d-ab1c98caabf5 is going to be updated. [ 608.012172] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.012500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.012500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.012588] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.012704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.012855] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc0e8808-038e-4c32-b54d-ab1c98caabf5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.143037] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a18ef3ce-d814-4cfb-b497-dbf659cd1988: rpc.has_security_group_logging(os_id): False [ 608.162321] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.162587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.162587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.163418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.163418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.163418] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.163418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.163418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.163418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.163418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.163728] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.163728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.163728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.163862] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.163909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.164112] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.164212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.164274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.164412] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.164717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.164717] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 is going to be created. [ 608.224200] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.224474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.224474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.224688] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.224891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.236352] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 in Status: IN_PROGRESS for 2s [ 608.286309] env[69692]: INFO networking_nsxv3.common.synchronization [None req-8e473362-3204-474c-96ce-dc78009c463e None None] Enqueued Resource ID: 2b6b087a-2c6f-44e6-8376-7c42eb421cef with Priority: HIGHEST for action port [ 608.286673] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b6b087a-2c6f-44e6-8376-7c42eb421cef with Priority: HIGHEST for action port [ 608.287203] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b6b087a-2c6f-44e6-8376-7c42eb421cef taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.287336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b6b087a-2c6f-44e6-8376-7c42eb421cef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.287399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b6b087a-2c6f-44e6-8376-7c42eb421cef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.287680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b6b087a-2c6f-44e6-8376-7c42eb421cef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.287783] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b6b087a-2c6f-44e6-8376-7c42eb421cef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.392851] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.393061] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.393306] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.393502] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.393678] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.393863] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port e5eefd40-96d3-414b-a9bf-84a05537de8d not found, creating... [ 608.394511] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.394511] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.394511] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.394802] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.394925] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.395278] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.395448] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.396679] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.396953] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.397123] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.397296] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: e5eefd40-96d3-414b-a9bf-84a05537de8d is going to be created. [ 608.422629] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.422629] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.422629] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.422629] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.422629] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.422629] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-e5eefd40-96d3-414b-a9bf-84a05537de8d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.491114] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('beac83ef-5694-434f-9cdc-fd976212be41',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.791428] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b6b087a-2c6f-44e6-8376-7c42eb421cef [ 608.791974] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.792152] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.792528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.792528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.792682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.792833] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b6b087a-2c6f-44e6-8376-7c42eb421cef already deleted. [ 608.792930] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b6b087a-2c6f-44e6-8376-7c42eb421cef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.997547] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.997704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.997773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.998683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.998683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.998683] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beac83ef-5694-434f-9cdc-fd976212be41 is going to be created. [ 609.021359] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.021631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.021631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.021893] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.022115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.034592] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beac83ef-5694-434f-9cdc-fd976212be41 in Status: UNINITIALIZED for 2s [ 609.122226] env[69692]: INFO networking_nsxv3.common.synchronization [None req-449d336a-f56b-4b3a-8221-af3c641bd739 None None] Enqueued Resource ID: d563638a-b4d9-46fa-8362-9456336512a8 with Priority: HIGHEST for action port [ 609.122226] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d563638a-b4d9-46fa-8362-9456336512a8 with Priority: HIGHEST for action port [ 609.122226] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-d563638a-b4d9-46fa-8362-9456336512a8 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.122226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d563638a-b4d9-46fa-8362-9456336512a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.122226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d563638a-b4d9-46fa-8362-9456336512a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.122226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d563638a-b4d9-46fa-8362-9456336512a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.123115] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d563638a-b4d9-46fa-8362-9456336512a8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.242352] env[69692]: INFO networking_nsxv3.common.synchronization [req-3c2e6a5d-39fe-41ee-aa83-080a1672b256 req-f3fa9053-0818-48cb-aae3-3166183ef5eb service nova] Enqueued Resource ID: b57d8773-fb88-48dd-8778-aad060b75558 with Priority: HIGHEST for action security_group_rules [ 609.242763] env[69692]: INFO networking_nsxv3.common.synchronization [req-3c2e6a5d-39fe-41ee-aa83-080a1672b256 req-f3fa9053-0818-48cb-aae3-3166183ef5eb service nova] Enqueued Resource ID: b57d8773-fb88-48dd-8778-aad060b75558 with Priority: HIGHEST for action security_group_members [ 609.243017] env[69692]: INFO networking_nsxv3.common.synchronization [req-3c2e6a5d-39fe-41ee-aa83-080a1672b256 req-f3fa9053-0818-48cb-aae3-3166183ef5eb service nova] Enqueued Resource ID: e5eefd40-96d3-414b-a9bf-84a05537de8d with Priority: HIGHEST for action port [ 609.244202] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b57d8773-fb88-48dd-8778-aad060b75558 with Priority: HIGHEST for action security_group_rules [ 609.244202] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b57d8773-fb88-48dd-8778-aad060b75558 with Priority: HIGHEST for action security_group_members [ 609.244202] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5eefd40-96d3-414b-a9bf-84a05537de8d with Priority: HIGHEST for action port [ 609.244569] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b57d8773-fb88-48dd-8778-aad060b75558 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.244741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.244815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.245613] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.245714] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b57d8773-fb88-48dd-8778-aad060b75558',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.247343] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b57d8773-fb88-48dd-8778-aad060b75558 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.247500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.247582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.247812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.249097] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.249097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.249097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.251040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.251216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.251396] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b57d8773-fb88-48dd-8778-aad060b75558',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.256218] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5eefd40-96d3-414b-a9bf-84a05537de8d taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.256381] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5eefd40-96d3-414b-a9bf-84a05537de8d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.256548] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5eefd40-96d3-414b-a9bf-84a05537de8d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.257039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5eefd40-96d3-414b-a9bf-84a05537de8d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.257143] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5eefd40-96d3-414b-a9bf-84a05537de8d',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.279274] env[69692]: INFO networking_nsxv3.common.synchronization [None req-21578872-4b70-4fe7-ac43-6f0aba60a71a None None] Enqueued Resource ID: 39309eed-646a-4989-892c-99aba0082f61 with Priority: HIGHEST for action port [ 609.279274] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39309eed-646a-4989-892c-99aba0082f61 with Priority: HIGHEST for action port [ 609.279608] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-39309eed-646a-4989-892c-99aba0082f61 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.279765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39309eed-646a-4989-892c-99aba0082f61" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.279814] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39309eed-646a-4989-892c-99aba0082f61" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.280125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39309eed-646a-4989-892c-99aba0082f61" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.280205] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39309eed-646a-4989-892c-99aba0082f61',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.626996] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d563638a-b4d9-46fa-8362-9456336512a8 [ 609.627306] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.627462] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.627536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.628161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.628161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.628161] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d563638a-b4d9-46fa-8362-9456336512a8 already deleted. [ 609.628161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d563638a-b4d9-46fa-8362-9456336512a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.756745] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b57d8773-fb88-48dd-8778-aad060b75558',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.759352] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b57d8773-fb88-48dd-8778-aad060b75558 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.759531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.760776] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5eefd40-96d3-414b-a9bf-84a05537de8d with status ACTIVE [ 609.760957] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.761082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.761165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.761369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.761460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.761716] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.761716] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.762030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.762030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.762030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.762209] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.762298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.762298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.762455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.762511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.762556] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5eefd40-96d3-414b-a9bf-84a05537de8d is going to be updated. [ 609.783166] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.783166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.783166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.783573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.784784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.784973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5eefd40-96d3-414b-a9bf-84a05537de8d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.785556] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39309eed-646a-4989-892c-99aba0082f61 [ 609.785556] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.785556] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.785556] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.785737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.785766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.785854] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39309eed-646a-4989-892c-99aba0082f61 already deleted. [ 609.785908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39309eed-646a-4989-892c-99aba0082f61" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.251777] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 in Status: SUCCESS [ 610.252059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.260531] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b57d8773-fb88-48dd-8778-aad060b75558',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.767023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.767023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.767023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.767023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.767023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.767023] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b57d8773-fb88-48dd-8778-aad060b75558 is going to be created. [ 610.787612] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.787750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.787817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.788116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.788275] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.797021] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b57d8773-fb88-48dd-8778-aad060b75558 in Status: UNINITIALIZED for 2s [ 611.045232] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beac83ef-5694-434f-9cdc-fd976212be41 in Status: SUCCESS [ 611.045537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.045815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.046173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.046444] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.046612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.046702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.046946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.050143] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.050143] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.050272] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('beac83ef-5694-434f-9cdc-fd976212be41',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.555576] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-beac83ef-5694-434f-9cdc-fd976212be41 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.555576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.555576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.555576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.555576] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.555576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.555576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.555576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.555576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.555576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.555576] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-beac83ef-5694-434f-9cdc-fd976212be41 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.555576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.555576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.555576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.555576] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.555576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.556668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.556668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.556668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.556668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.556668] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('beac83ef-5694-434f-9cdc-fd976212be41',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.611652] env[69692]: INFO networking_nsxv3.common.synchronization [None req-0dc8dae7-feb1-42af-b92d-9deddd7264ce None None] Enqueued Resource ID: 8ca917d1-60a3-4ed5-88aa-ca5485ea9c5b with Priority: HIGHEST for action port [ 611.613492] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ca917d1-60a3-4ed5-88aa-ca5485ea9c5b with Priority: HIGHEST for action port [ 611.613492] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ca917d1-60a3-4ed5-88aa-ca5485ea9c5b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.613492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ca917d1-60a3-4ed5-88aa-ca5485ea9c5b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.613492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ca917d1-60a3-4ed5-88aa-ca5485ea9c5b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.613947] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ca917d1-60a3-4ed5-88aa-ca5485ea9c5b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.614051] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ca917d1-60a3-4ed5-88aa-ca5485ea9c5b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.756740] env[69692]: INFO networking_nsxv3.common.synchronization [None req-31f66a32-e881-4d59-a141-adf40307ebcf None None] Enqueued Resource ID: 6cbc7800-320f-43f8-972d-f0f216abf54e with Priority: HIGHEST for action port [ 611.757284] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cbc7800-320f-43f8-972d-f0f216abf54e with Priority: HIGHEST for action port [ 611.757787] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cbc7800-320f-43f8-972d-f0f216abf54e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.757901] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cbc7800-320f-43f8-972d-f0f216abf54e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.757988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cbc7800-320f-43f8-972d-f0f216abf54e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.758453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cbc7800-320f-43f8-972d-f0f216abf54e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.758538] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cbc7800-320f-43f8-972d-f0f216abf54e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.058052] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for beac83ef-5694-434f-9cdc-fd976212be41: rpc.has_security_group_logging(os_id): False [ 612.075765] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.075921] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.075992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.076322] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.076322] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.076486] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.076603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.076656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.076803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.076896] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.077074] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.077169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.077230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.077377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.077435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.077613] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.078173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.078173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.078173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.078173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.078173] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beac83ef-5694-434f-9cdc-fd976212be41 is going to be created. [ 612.117756] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ca917d1-60a3-4ed5-88aa-ca5485ea9c5b [ 612.117756] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.117756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.117756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.117756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.117756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.117756] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ca917d1-60a3-4ed5-88aa-ca5485ea9c5b already deleted. [ 612.117756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ca917d1-60a3-4ed5-88aa-ca5485ea9c5b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.139218] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.139359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.139469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.139623] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.139799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.150081] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: beac83ef-5694-434f-9cdc-fd976212be41 in Status: IN_PROGRESS for 2s [ 612.259601] env[69692]: INFO networking_nsxv3.common.synchronization [req-f82ec91e-c10b-47d8-aa6a-3022379bce4e req-9f149efc-2019-4f64-9ccd-da05adccb1c7 tempest-DeleteServersAdminTestJSON-637928386 tempest-DeleteServersAdminTestJSON-637928386-project-admin] Enqueued Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_members [ 612.261285] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_members [ 612.261285] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cbc7800-320f-43f8-972d-f0f216abf54e [ 612.261285] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.261285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.261285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.261285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.261285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.261285] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cbc7800-320f-43f8-972d-f0f216abf54e already deleted. [ 612.261285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cbc7800-320f-43f8-972d-f0f216abf54e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.261658] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.261658] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.261658] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.261798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.261947] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.262046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.262103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.262239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.262310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.262393] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.765509] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.765807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.767810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.767810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.767810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.767810] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.768332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.768332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.768332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.768332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.768332] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb is going to be updated. [ 612.805982] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.806169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.806215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.806420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.806557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.811219] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b57d8773-fb88-48dd-8778-aad060b75558 in Status: SUCCESS [ 612.811450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.811976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.812631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.812631] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.812631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.812631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.812830] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.812830] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.812830] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.812919] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b57d8773-fb88-48dd-8778-aad060b75558',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.822315] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: IN_PROGRESS for 2s [ 612.984660] env[69692]: INFO networking_nsxv3.common.synchronization [None req-b9a7173c-9962-4667-a76d-56051903bd72 tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGHEST for action security_group_rules [ 612.984660] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGHEST for action security_group_rules [ 612.984660] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-501c3651-4f53-4420-b2dc-d80ff25930b1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.984660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.984660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.984660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.984660] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.205666] env[69692]: INFO networking_nsxv3.common.synchronization [None req-c87f5d1e-c2ac-4b9b-85ea-32872aa6710b tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGHEST for action security_group_rules [ 613.207353] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGHEST for action security_group_rules [ 613.208542] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-501c3651-4f53-4420-b2dc-d80ff25930b1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.208542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.242646] env[69692]: INFO networking_nsxv3.common.synchronization [req-d9f8b49f-2667-4828-a14c-fd84f975564f req-cb7d9df3-6830-4c90-9f55-7dcb6f4e2cb6 tempest-MigrationsAdminTest-1006177328 tempest-MigrationsAdminTest-1006177328-project-member] Enqueued Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_members [ 613.243209] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_members [ 613.243711] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.243843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.244227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.245747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.245747] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.245747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.245747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.246444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.246563] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.246644] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.316211] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b57d8773-fb88-48dd-8778-aad060b75558 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.316546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.316546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.317121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.317121] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.317121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.317121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.317720] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.320829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.320829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.320829] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b57d8773-fb88-48dd-8778-aad060b75558 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.320829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.320829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.320829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.320829] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.320829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.320829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.320829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.320829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.320829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.320829] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b57d8773-fb88-48dd-8778-aad060b75558',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.505035] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.505035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.505035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.505035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.505035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.505035] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 already deleted. [ 613.505035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.506013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.506201] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.506540] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.751100] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.751100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.751100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.751100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.751100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.751100] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.751100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.751100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.751397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.751397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.751397] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803064c7-17f8-46ee-bdf3-20357514c794 already deleted. [ 613.751526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.824987] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b57d8773-fb88-48dd-8778-aad060b75558: rpc.has_security_group_logging(os_id): False [ 613.844024] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.844206] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.844268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.844438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.844546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.844918] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.844918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.844918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.845134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.845134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.845327] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.845489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.845489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.845588] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.845728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.845839] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.846061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.846061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.846408] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.846477] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.846573] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b57d8773-fb88-48dd-8778-aad060b75558 is going to be created. [ 613.903669] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.903827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.903897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.904150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.904344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.920106] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b57d8773-fb88-48dd-8778-aad060b75558 in Status: IN_PROGRESS for 2s [ 613.921040] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.921229] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.921328] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.921616] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.921935] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.922083] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.922201] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.922418] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.922554] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.922759] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 613.922864] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.925284] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.925284] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.925284] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 613.925284] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.925284] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.941902] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.941950] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 613.943064] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.943064] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.943064] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-2ef2e7c8-0270-4c87-b05b-5589679d44b4 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.943064] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-2ef2e7c8-0270-4c87-b05b-5589679d44b4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.943064] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-2ef2e7c8-0270-4c87-b05b-5589679d44b4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.943404] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-2ef2e7c8-0270-4c87-b05b-5589679d44b4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.943518] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ef2e7c8-0270-4c87-b05b-5589679d44b4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.030668] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.030668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.030668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.030668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.030668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.030668] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 already deleted. [ 614.030668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.163896] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: beac83ef-5694-434f-9cdc-fd976212be41 in Status: SUCCESS [ 614.164065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.172852] env[69692]: INFO networking_nsxv3.common.synchronization [None req-67c2b181-8c3c-426a-85dd-a24bb601ad88 None None] Enqueued Resource ID: 1b6b9e73-0c10-43c7-b7da-634f58102d32 with Priority: HIGHEST for action port [ 614.175734] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b6b9e73-0c10-43c7-b7da-634f58102d32 with Priority: HIGHEST for action port [ 614.176359] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b6b9e73-0c10-43c7-b7da-634f58102d32 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.176604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b6b9e73-0c10-43c7-b7da-634f58102d32" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.176739] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b6b9e73-0c10-43c7-b7da-634f58102d32" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.177262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b6b9e73-0c10-43c7-b7da-634f58102d32" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.177507] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b6b9e73-0c10-43c7-b7da-634f58102d32',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.451619] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.451619] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.451619] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.451619] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.451619] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.451619] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 2ef2e7c8-0270-4c87-b05b-5589679d44b4 not found, creating... [ 614.451619] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.451619] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.451619] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.451619] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.452366] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.452366] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.452366] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.452366] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.452576] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.452576] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.452898] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 2ef2e7c8-0270-4c87-b05b-5589679d44b4 is going to be created. [ 614.471275] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.471555] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.471601] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.471862] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.472110] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.472325] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-2ef2e7c8-0270-4c87-b05b-5589679d44b4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.681827] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b6b9e73-0c10-43c7-b7da-634f58102d32 [ 614.682090] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.682238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.682300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.682486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.682577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.682672] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b6b9e73-0c10-43c7-b7da-634f58102d32 already deleted. [ 614.682755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b6b9e73-0c10-43c7-b7da-634f58102d32" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.831830] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: SUCCESS [ 614.832137] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb deletion is rescheduled due to dependency. [ 614.832361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.423016] env[69692]: INFO networking_nsxv3.common.synchronization [req-db3c09cf-55d0-4881-8856-7f993bf6f49d req-e40f10d3-464b-48c9-8630-7b54058c164b tempest-ServerExternalEventsTest-1529359532 tempest-ServerExternalEventsTest-1529359532-project-member] Enqueued Resource ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 with Priority: HIGHEST for action security_group_members [ 615.423569] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 with Priority: HIGHEST for action security_group_members [ 615.423889] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef05655-0d1f-4345-946e-e5a87b85a408 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.424023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.424090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.424373] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.424570] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.424696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.424764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.425023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.425023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.425139] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ef05655-0d1f-4345-946e-e5a87b85a408',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.617318] env[69692]: INFO networking_nsxv3.common.synchronization [req-69c30977-559d-4eeb-a3ba-2b9db4ac58ee req-43ff346b-ecee-43c5-add6-2c6f903808b5 tempest-ServerDiagnosticsTest-2133587746 tempest-ServerDiagnosticsTest-2133587746-project-member] Enqueued Resource ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 with Priority: HIGHEST for action security_group_members [ 615.617318] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 with Priority: HIGHEST for action security_group_members [ 615.617594] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18ef3ce-d814-4cfb-b497-dbf659cd1988 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.617594] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.617594] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.617724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.617904] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.617960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.618360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.618557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.618642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.618734] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18ef3ce-d814-4cfb-b497-dbf659cd1988',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.789969] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.790578] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.790578] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.790706] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.791177] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.791177] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.791177] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.791556] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.791556] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.791793] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 615.791793] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.792837] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.792837] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.792837] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 615.792837] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.792837] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.811644] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.811644] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 615.811792] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.811840] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.813853] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-decdb133-74fc-41be-8a81-cc123617cb39 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.814357] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-decdb133-74fc-41be-8a81-cc123617cb39" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.814444] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-decdb133-74fc-41be-8a81-cc123617cb39" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.814729] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-decdb133-74fc-41be-8a81-cc123617cb39" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.814891] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('decdb133-74fc-41be-8a81-cc123617cb39',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.842810] env[69692]: INFO networking_nsxv3.common.synchronization [req-d9f8b49f-2667-4828-a14c-fd84f975564f req-827c8114-627a-4a0b-a095-97b66f22ca30 service nova] Enqueued Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_rules [ 615.843072] env[69692]: INFO networking_nsxv3.common.synchronization [req-d9f8b49f-2667-4828-a14c-fd84f975564f req-827c8114-627a-4a0b-a095-97b66f22ca30 service nova] Enqueued Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_members [ 615.843823] env[69692]: INFO networking_nsxv3.common.synchronization [req-d9f8b49f-2667-4828-a14c-fd84f975564f req-827c8114-627a-4a0b-a095-97b66f22ca30 service nova] Enqueued Resource ID: 2ef2e7c8-0270-4c87-b05b-5589679d44b4 with Priority: HIGHEST for action port [ 615.843823] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_rules [ 615.843987] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_members [ 615.844062] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ef2e7c8-0270-4c87-b05b-5589679d44b4 with Priority: HIGHEST for action port [ 615.844702] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.844895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.844955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.845399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.845488] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.847231] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.847308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.847384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.849163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.849163] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.849163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.849163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.849163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.849163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.849163] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.849722] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ef2e7c8-0270-4c87-b05b-5589679d44b4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.849852] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ef2e7c8-0270-4c87-b05b-5589679d44b4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.849922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ef2e7c8-0270-4c87-b05b-5589679d44b4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.850168] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ef2e7c8-0270-4c87-b05b-5589679d44b4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.850252] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ef2e7c8-0270-4c87-b05b-5589679d44b4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.926919] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.927520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.927520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.927520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.927520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.927721] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.927721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.927822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.927930] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.927976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.928098] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 already deleted. [ 615.928148] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.934397] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b57d8773-fb88-48dd-8778-aad060b75558 in Status: SUCCESS [ 615.934612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.121371] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.121802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.121802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.121802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.121965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.122438] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.122438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.122438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.122438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.122882] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.122882] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 is going to be updated. [ 616.150815] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.152230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.152230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.152656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.154018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.161306] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 in Status: IN_PROGRESS for 2s [ 616.319677] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.321877] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.321877] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.321877] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.321877] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.321877] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port decdb133-74fc-41be-8a81-cc123617cb39 not found, creating... [ 616.322507] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.322507] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.322507] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.322780] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.322780] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.323698] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.323851] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.324157] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.324813] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.324968] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.325152] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: decdb133-74fc-41be-8a81-cc123617cb39 is going to be created. [ 616.350086] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.352693] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.352889] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.355354] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.355354] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.355354] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.355608] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-decdb133-74fc-41be-8a81-cc123617cb39" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.356186] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ef2e7c8-0270-4c87-b05b-5589679d44b4 with status ACTIVE [ 616.356793] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.356900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.356900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.357607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.357607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.357607] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.357607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.357607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.358055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.358055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.358055] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.358055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.358055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.358298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.358298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.358364] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ef2e7c8-0270-4c87-b05b-5589679d44b4 is going to be updated. [ 616.359752] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.359943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.381575] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.381575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.381575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.381575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.381575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.381575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ef2e7c8-0270-4c87-b05b-5589679d44b4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.862131] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.237129] env[69692]: INFO networking_nsxv3.common.synchronization [req-db3c09cf-55d0-4881-8856-7f993bf6f49d req-3eb074b0-5f42-43a4-9e89-45fadc7c3c30 service nova] Enqueued Resource ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 with Priority: HIGHEST for action security_group_rules [ 617.238083] env[69692]: INFO networking_nsxv3.common.synchronization [req-db3c09cf-55d0-4881-8856-7f993bf6f49d req-3eb074b0-5f42-43a4-9e89-45fadc7c3c30 service nova] Enqueued Resource ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 with Priority: HIGHEST for action security_group_members [ 617.239258] env[69692]: INFO networking_nsxv3.common.synchronization [req-db3c09cf-55d0-4881-8856-7f993bf6f49d req-3eb074b0-5f42-43a4-9e89-45fadc7c3c30 service nova] Enqueued Resource ID: decdb133-74fc-41be-8a81-cc123617cb39 with Priority: HIGHEST for action port [ 617.239947] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 with Priority: HIGHEST for action security_group_rules [ 617.240198] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 with Priority: HIGHEST for action security_group_members [ 617.240332] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: decdb133-74fc-41be-8a81-cc123617cb39 with Priority: HIGHEST for action port [ 617.240723] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ef05655-0d1f-4345-946e-e5a87b85a408 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.240878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.240948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.241221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.241313] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ef05655-0d1f-4345-946e-e5a87b85a408',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.243775] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef05655-0d1f-4345-946e-e5a87b85a408 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.243849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.243886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.244352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.244352] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.244475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.244475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.244670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.244736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.244848] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ef05655-0d1f-4345-946e-e5a87b85a408',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.246160] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-decdb133-74fc-41be-8a81-cc123617cb39 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.246160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-decdb133-74fc-41be-8a81-cc123617cb39" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.246160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-decdb133-74fc-41be-8a81-cc123617cb39" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.246365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-decdb133-74fc-41be-8a81-cc123617cb39" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.246365] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('decdb133-74fc-41be-8a81-cc123617cb39',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.364313] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.364543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.364658] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.364829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.364946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.365074] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803064c7-17f8-46ee-bdf3-20357514c794 is going to be created. [ 617.387218] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.387313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.390414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.390414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.390414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.396655] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: UNINITIALIZED for 2s [ 617.580850] env[69692]: INFO networking_nsxv3.common.synchronization [req-0e6c5f59-7e2f-4ae9-a793-cbbcec9283ef req-36ca0c70-54ee-421c-ab0a-4110819f2643 tempest-TenantUsagesTestJSON-132239226 tempest-TenantUsagesTestJSON-132239226-project-member] Enqueued Resource ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f with Priority: HIGHEST for action security_group_members [ 617.581410] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f with Priority: HIGHEST for action security_group_members [ 617.581710] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.581983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.582156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.582456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.582872] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.583146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.583225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.583387] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.583473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.584380] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb8b39ac-23d5-452c-9ec6-33c3aa98d53f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.748777] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef05655-0d1f-4345-946e-e5a87b85a408 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.750060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.750060] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ef05655-0d1f-4345-946e-e5a87b85a408',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.750741] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port decdb133-74fc-41be-8a81-cc123617cb39 with status ACTIVE [ 617.751209] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.751389] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.751503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.751737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.751856] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.752073] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.752345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.753653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.753653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.753653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.753653] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.753653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.753653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.753653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.753653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.753653] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: decdb133-74fc-41be-8a81-cc123617cb39 is going to be updated. [ 617.774407] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.774407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.774407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.774407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.774407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.774407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-decdb133-74fc-41be-8a81-cc123617cb39" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.070855] env[69692]: INFO networking_nsxv3.common.synchronization [req-b9b61787-063c-4cba-b5c2-1ea79480a596 req-c6f4ac71-ad52-4869-b153-4fc996ac7a1f tempest-VolumesAdminNegativeTest-1078272547 tempest-VolumesAdminNegativeTest-1078272547-project-member] Enqueued Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGHEST for action security_group_members [ 618.071309] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGHEST for action security_group_members [ 618.071585] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0606438c-ea63-4fae-97b5-53d1cd997a59 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.071755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.071830] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.072085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.072245] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.072804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.072804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.072804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.072804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.072978] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.088027] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.088027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.088027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.088027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.088027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.088278] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.088278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.088359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.088458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.088522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.088611] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f is going to be updated. [ 618.114336] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.114497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.114497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.115398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.115398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.122795] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f in Status: IN_PROGRESS for 2s [ 618.170531] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 in Status: SUCCESS [ 618.170907] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 deletion is rescheduled due to dependency. [ 618.170907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.251887] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ef05655-0d1f-4345-946e-e5a87b85a408',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.575655] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.575845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.575891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.576566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.576566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.576566] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.576566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.576566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.576847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.576903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.576936] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 already deleted. [ 618.577051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.756877] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.756877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.756877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.756877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.756877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.756877] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 is going to be created. [ 618.782181] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.782323] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.782371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.782572] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.782734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.792845] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 in Status: UNINITIALIZED for 2s [ 619.256518] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.256518] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-267" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.256518] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-267" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.256518] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-267" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.261099] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.261099] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.261099] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.261099] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.261099] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.261099] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 619.261099] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.261099] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.261099] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.261099] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 619.262049] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.262049] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.280947] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.281247] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 619.281354] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.281539] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-267" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.281884] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-9512295a-ae47-4627-baea-ea55f8a35c0b taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.282109] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-9512295a-ae47-4627-baea-ea55f8a35c0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.284021] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-9512295a-ae47-4627-baea-ea55f8a35c0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.284021] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-9512295a-ae47-4627-baea-ea55f8a35c0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.284021] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9512295a-ae47-4627-baea-ea55f8a35c0b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.412027] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: SUCCESS [ 619.412027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.412027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.412027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.412027] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.412027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.412027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.412027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.412027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.412027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.412027] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.787753] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.787920] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.788060] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.788353] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.788595] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.788660] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 9512295a-ae47-4627-baea-ea55f8a35c0b not found, creating... [ 619.788893] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.789113] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.789659] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.790124] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.790124] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.792316] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.792316] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.792316] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.792316] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.792316] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.792316] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 9512295a-ae47-4627-baea-ea55f8a35c0b is going to be created. [ 619.813598] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.813598] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.813598] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.813598] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.813598] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.813598] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-9512295a-ae47-4627-baea-ea55f8a35c0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.915111] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.915324] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.915476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.915847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.915996] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.916085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.916156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.916538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.916538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.916538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.916838] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.917088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.917088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.917250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.917596] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.917723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.917788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.917938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.918071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.918108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.918294] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.006170] env[69692]: INFO networking_nsxv3.common.synchronization [None req-ada6d858-baf2-4ea8-a15d-95dcbb9a4c7c None None] Enqueued Resource ID: 2070e894-afab-4b1c-8a76-8fcd611efea1 with Priority: HIGHEST for action port [ 620.007205] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2070e894-afab-4b1c-8a76-8fcd611efea1 with Priority: HIGHEST for action port [ 620.007609] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-2070e894-afab-4b1c-8a76-8fcd611efea1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.007757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2070e894-afab-4b1c-8a76-8fcd611efea1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.007824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2070e894-afab-4b1c-8a76-8fcd611efea1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.011571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2070e894-afab-4b1c-8a76-8fcd611efea1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.011571] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2070e894-afab-4b1c-8a76-8fcd611efea1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.131479] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f in Status: SUCCESS [ 620.131659] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb8b39ac-23d5-452c-9ec6-33c3aa98d53f deletion is rescheduled due to dependency. [ 620.131773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb8b39ac-23d5-452c-9ec6-33c3aa98d53f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.421129] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 803064c7-17f8-46ee-bdf3-20357514c794: rpc.has_security_group_logging(os_id): False [ 620.440454] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.440624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.440699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.440923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.441075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.441280] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.441420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.441508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.441681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.441792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.442033] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.442150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.442250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.442955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.442955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.442955] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.442955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.442955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.443754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.443895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.444020] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 803064c7-17f8-46ee-bdf3-20357514c794 is going to be created. [ 620.497168] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.497336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.497377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.497564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.497750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.508109] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: IN_PROGRESS for 2s [ 620.510337] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2070e894-afab-4b1c-8a76-8fcd611efea1 [ 620.510561] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.510684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.510751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.511049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.511134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.511199] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2070e894-afab-4b1c-8a76-8fcd611efea1 already deleted. [ 620.511277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2070e894-afab-4b1c-8a76-8fcd611efea1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.803157] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 in Status: SUCCESS [ 620.803157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.803157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.803157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.803157] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.803157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.803157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.803595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.803595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.803595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.803595] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ef05655-0d1f-4345-946e-e5a87b85a408',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.849638] env[69692]: INFO networking_nsxv3.common.synchronization [req-b9b61787-063c-4cba-b5c2-1ea79480a596 req-4ae2c19d-bc22-425b-bdb3-0a5fcc1ff914 service nova] Enqueued Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGHEST for action security_group_rules [ 620.849638] env[69692]: INFO networking_nsxv3.common.synchronization [req-b9b61787-063c-4cba-b5c2-1ea79480a596 req-4ae2c19d-bc22-425b-bdb3-0a5fcc1ff914 service nova] Enqueued Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGHEST for action security_group_members [ 620.849638] env[69692]: INFO networking_nsxv3.common.synchronization [req-b9b61787-063c-4cba-b5c2-1ea79480a596 req-4ae2c19d-bc22-425b-bdb3-0a5fcc1ff914 service nova] Enqueued Resource ID: 9512295a-ae47-4627-baea-ea55f8a35c0b with Priority: HIGHEST for action port [ 620.849638] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGHEST for action security_group_rules [ 620.849638] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGHEST for action security_group_members [ 620.849638] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9512295a-ae47-4627-baea-ea55f8a35c0b with Priority: HIGHEST for action port [ 620.849638] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0606438c-ea63-4fae-97b5-53d1cd997a59 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.849638] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.849638] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.849638] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.849638] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.853396] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0606438c-ea63-4fae-97b5-53d1cd997a59 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.855120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.855226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.855471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.855680] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.859431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.859431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.859431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.859431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.859431] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.860011] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-9512295a-ae47-4627-baea-ea55f8a35c0b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.860011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9512295a-ae47-4627-baea-ea55f8a35c0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.860594] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9512295a-ae47-4627-baea-ea55f8a35c0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.861056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9512295a-ae47-4627-baea-ea55f8a35c0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.862721] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9512295a-ae47-4627-baea-ea55f8a35c0b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.204669] env[69692]: INFO networking_nsxv3.common.synchronization [req-247dd92a-f80b-41ac-8d8e-27568056eeab req-28a84105-ecf1-4dcc-b1c8-852baf8083ae tempest-InstanceActionsV221TestJSON-2110776459 tempest-InstanceActionsV221TestJSON-2110776459-project-member] Enqueued Resource ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab with Priority: HIGHEST for action security_group_members [ 621.204669] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab with Priority: HIGHEST for action security_group_members [ 621.205653] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab04df45-cf74-4894-8e09-dc03e4e3ecab taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.205976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.206060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.206366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.206566] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.206707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.206775] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.207069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.207224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.207382] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab04df45-cf74-4894-8e09-dc03e4e3ecab',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.309040] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef05655-0d1f-4345-946e-e5a87b85a408 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.309040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.309040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.309040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.309040] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.309040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.309040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.309040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.309040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.309040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.309040] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef05655-0d1f-4345-946e-e5a87b85a408 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.309040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.309040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.309040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.309040] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.309040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.310054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.310054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.310054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.310054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.310054] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ef05655-0d1f-4345-946e-e5a87b85a408',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.364944] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0606438c-ea63-4fae-97b5-53d1cd997a59 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.364944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.364944] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.366234] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9512295a-ae47-4627-baea-ea55f8a35c0b with status ACTIVE [ 621.366234] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.366234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.366234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.366234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.366234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.366515] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.366515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.366586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.366726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.366794] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.368732] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.368732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.368732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.368732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.368732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.368982] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9512295a-ae47-4627-baea-ea55f8a35c0b is going to be updated. [ 621.391303] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.392346] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.392460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.392615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.392758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.392927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9512295a-ae47-4627-baea-ea55f8a35c0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.579355] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-826 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.579745] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-826" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.579745] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-826" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.580027] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-826" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.581330] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.581768] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.581893] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.582997] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.583236] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.583458] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 621.583576] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.583691] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.583826] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.583914] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 621.584031] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.584174] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.602557] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.603826] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 621.603826] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.603826] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-826" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.604097] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-1de50a9e-be3e-4dfb-9d5f-387e96c2f720 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.604097] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-1de50a9e-be3e-4dfb-9d5f-387e96c2f720" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.604218] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-1de50a9e-be3e-4dfb-9d5f-387e96c2f720" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.604532] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-1de50a9e-be3e-4dfb-9d5f-387e96c2f720" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.604673] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1de50a9e-be3e-4dfb-9d5f-387e96c2f720',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.710216] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.710370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.710432] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.710649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.710877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.711214] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.711345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.711345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.712029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.712029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.712029] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab already deleted. [ 621.712029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.813188] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ef05655-0d1f-4345-946e-e5a87b85a408: rpc.has_security_group_logging(os_id): False [ 621.831177] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.831177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.831177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.831177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.831177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.831177] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.831177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.831177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.831177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.831177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.831177] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.831177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.831177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.831177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.831177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.831729] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.831729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.831729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.832310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.832421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.832523] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 is going to be created. [ 621.856718] env[69692]: INFO networking_nsxv3.common.synchronization [None req-fb61e8c0-f7d3-4c10-90d7-6d44bdf9492e None None] Enqueued Resource ID: a1078b1f-362e-46e7-9f22-e43597165d4e with Priority: HIGHEST for action port [ 621.857285] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1078b1f-362e-46e7-9f22-e43597165d4e with Priority: HIGHEST for action port [ 621.857584] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1078b1f-362e-46e7-9f22-e43597165d4e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.857708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1078b1f-362e-46e7-9f22-e43597165d4e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.857778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1078b1f-362e-46e7-9f22-e43597165d4e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.858330] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1078b1f-362e-46e7-9f22-e43597165d4e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.858468] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1078b1f-362e-46e7-9f22-e43597165d4e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.871501] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.898399] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.898540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.898598] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.898885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.898977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.916462] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 in Status: IN_PROGRESS for 2s [ 621.982599] env[69692]: INFO networking_nsxv3.common.synchronization [None req-90514c30-6d43-4ab0-8296-2c623a327e1b None None] Enqueued Resource ID: d1b8590a-302b-40bb-b0d6-bbc026ca596a with Priority: HIGHEST for action port [ 621.982968] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1b8590a-302b-40bb-b0d6-bbc026ca596a with Priority: HIGHEST for action port [ 621.983867] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1b8590a-302b-40bb-b0d6-bbc026ca596a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.983867] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1b8590a-302b-40bb-b0d6-bbc026ca596a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.983867] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1b8590a-302b-40bb-b0d6-bbc026ca596a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.984968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1b8590a-302b-40bb-b0d6-bbc026ca596a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.985096] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1b8590a-302b-40bb-b0d6-bbc026ca596a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.108563] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.108813] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.108970] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.109656] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.109839] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.110019] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 1de50a9e-be3e-4dfb-9d5f-387e96c2f720 not found, creating... [ 622.110649] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.110848] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.111167] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.111498] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.111661] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.112020] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.112215] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.112342] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.112597] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.112746] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.112920] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 1de50a9e-be3e-4dfb-9d5f-387e96c2f720 is going to be created. [ 622.133870] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.134191] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.135057] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.135057] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.135057] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.135251] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-1de50a9e-be3e-4dfb-9d5f-387e96c2f720" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.260534] env[69692]: INFO networking_nsxv3.common.synchronization [None req-be22d52a-6e66-4323-9880-598dba6fa72a None None] Enqueued Resource ID: 95bb1276-170d-49dd-9966-a87f5a0ac6d0 with Priority: HIGHEST for action port [ 622.260534] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95bb1276-170d-49dd-9966-a87f5a0ac6d0 with Priority: HIGHEST for action port [ 622.260856] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-95bb1276-170d-49dd-9966-a87f5a0ac6d0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.260982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95bb1276-170d-49dd-9966-a87f5a0ac6d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.261052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95bb1276-170d-49dd-9966-a87f5a0ac6d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.261724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95bb1276-170d-49dd-9966-a87f5a0ac6d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.261724] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95bb1276-170d-49dd-9966-a87f5a0ac6d0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.361032] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1078b1f-362e-46e7-9f22-e43597165d4e [ 622.361032] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.361032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.361032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.361261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.361350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.361383] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1078b1f-362e-46e7-9f22-e43597165d4e already deleted. [ 622.361453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1078b1f-362e-46e7-9f22-e43597165d4e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.374226] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.374226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.374226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.374226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.374226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.374226] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 is going to be created. [ 622.398178] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.398329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.398383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.398587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.398746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.410896] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 in Status: UNINITIALIZED for 2s [ 622.487723] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1b8590a-302b-40bb-b0d6-bbc026ca596a [ 622.488941] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.488941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.488941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.488941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.488941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.488941] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1b8590a-302b-40bb-b0d6-bbc026ca596a already deleted. [ 622.488941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1b8590a-302b-40bb-b0d6-bbc026ca596a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.521970] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: SUCCESS [ 622.522368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.763872] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95bb1276-170d-49dd-9966-a87f5a0ac6d0 [ 622.765446] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.765446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.765446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.765446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.765446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.765446] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95bb1276-170d-49dd-9966-a87f5a0ac6d0 already deleted. [ 622.765446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95bb1276-170d-49dd-9966-a87f5a0ac6d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.224145] env[69692]: INFO networking_nsxv3.common.synchronization [req-247dd92a-f80b-41ac-8d8e-27568056eeab req-b3445d53-8eb8-4270-9d6b-23878c4257c9 service nova] Enqueued Resource ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab with Priority: HIGHEST for action security_group_rules [ 623.224359] env[69692]: INFO networking_nsxv3.common.synchronization [req-247dd92a-f80b-41ac-8d8e-27568056eeab req-b3445d53-8eb8-4270-9d6b-23878c4257c9 service nova] Enqueued Resource ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab with Priority: HIGHEST for action security_group_members [ 623.224560] env[69692]: INFO networking_nsxv3.common.synchronization [req-247dd92a-f80b-41ac-8d8e-27568056eeab req-b3445d53-8eb8-4270-9d6b-23878c4257c9 service nova] Enqueued Resource ID: 1de50a9e-be3e-4dfb-9d5f-387e96c2f720 with Priority: HIGHEST for action port [ 623.225492] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab with Priority: HIGHEST for action security_group_rules [ 623.225729] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab with Priority: HIGHEST for action security_group_members [ 623.225869] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de50a9e-be3e-4dfb-9d5f-387e96c2f720 with Priority: HIGHEST for action port [ 623.226194] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab04df45-cf74-4894-8e09-dc03e4e3ecab taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.226423] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.226518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.226781] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.226864] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab04df45-cf74-4894-8e09-dc03e4e3ecab',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.227898] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab04df45-cf74-4894-8e09-dc03e4e3ecab taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.231176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.231176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.231176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.231176] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.231176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.231176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.231176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.231176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.231176] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab04df45-cf74-4894-8e09-dc03e4e3ecab',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.231176] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-1de50a9e-be3e-4dfb-9d5f-387e96c2f720 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.231176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1de50a9e-be3e-4dfb-9d5f-387e96c2f720" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.231176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1de50a9e-be3e-4dfb-9d5f-387e96c2f720" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.231176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1de50a9e-be3e-4dfb-9d5f-387e96c2f720" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.231176] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1de50a9e-be3e-4dfb-9d5f-387e96c2f720',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.346901] env[69692]: INFO networking_nsxv3.common.synchronization [req-7fc5efcb-790e-4685-81b3-0eaa5e55bd47 req-d2928c3a-2b52-45c7-879e-6ade371400db tempest-ServersTestJSON-1710059859 tempest-ServersTestJSON-1710059859-project-member] Enqueued Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGHEST for action security_group_members [ 623.347561] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGHEST for action security_group_members [ 623.347879] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9ea5c0-4781-4575-9fde-6a93632303e0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.349822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.349955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.350282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.350595] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.350771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.350856] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.350946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.351176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.351316] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d9ea5c0-4781-4575-9fde-6a93632303e0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.734457] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab04df45-cf74-4894-8e09-dc03e4e3ecab taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.735681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.735681] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1de50a9e-be3e-4dfb-9d5f-387e96c2f720 with status ACTIVE [ 623.735681] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.735681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.735681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.735906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.736714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.737926] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.737926] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.737926] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.738126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.738303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.738428] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.738535] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.738599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.738764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.738843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.738930] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1de50a9e-be3e-4dfb-9d5f-387e96c2f720 is going to be updated. [ 623.742858] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab04df45-cf74-4894-8e09-dc03e4e3ecab',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.757152] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.757152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.757152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.757152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.757152] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.757152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.757152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.757152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.757152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.757152] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 623.757152] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.757152] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.757152] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.757916] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 623.757916] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.757916] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.761749] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.761749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.761749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.761749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.765197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.765197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1de50a9e-be3e-4dfb-9d5f-387e96c2f720" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.775015] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.775271] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 623.775389] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.775999] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.775999] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-cd17c847-64c1-49e7-8fd9-1467d5cb193f taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.776190] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-cd17c847-64c1-49e7-8fd9-1467d5cb193f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.776263] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-cd17c847-64c1-49e7-8fd9-1467d5cb193f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.776589] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-cd17c847-64c1-49e7-8fd9-1467d5cb193f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.777217] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd17c847-64c1-49e7-8fd9-1467d5cb193f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.854786] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.854786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.854786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.854786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.854786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.855067] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.855067] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.855067] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.855231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.855283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.855324] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 already deleted. [ 623.855434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.928197] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 in Status: SUCCESS [ 623.928807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.246675] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab04df45-cf74-4894-8e09-dc03e4e3ecab',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.282147] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.282854] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.283023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.283335] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.283503] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.283744] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port cd17c847-64c1-49e7-8fd9-1467d5cb193f not found, creating... [ 624.284181] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.284181] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.284296] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.284558] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.285319] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.285670] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.285816] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.286063] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.286277] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.286392] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.286513] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: cd17c847-64c1-49e7-8fd9-1467d5cb193f is going to be created. [ 624.309845] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.310264] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.310468] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.310836] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.311384] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.311996] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-cd17c847-64c1-49e7-8fd9-1467d5cb193f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.396850] env[69692]: INFO networking_nsxv3.common.synchronization [None req-4661b042-b140-4ca9-b472-f45071261d4a tempest-AttachInterfacesUnderV243Test-2039607704 tempest-AttachInterfacesUnderV243Test-2039607704-project-member] Enqueued Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_rules [ 624.396850] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_rules [ 624.396850] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.397592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.397592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.397592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.397592] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.424659] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 in Status: SUCCESS [ 624.424659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.424835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.425332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.425332] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.425518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.425518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.425587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.425662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.425726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.425832] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.580099] env[69692]: INFO networking_nsxv3.common.synchronization [None req-453c19fd-09d2-4f28-8649-a273a4a93629 tempest-AttachInterfacesUnderV243Test-2039607704 tempest-AttachInterfacesUnderV243Test-2039607704-project-member] Enqueued Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_rules [ 624.580673] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_rules [ 624.583361] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.583506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.749506] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.749650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.749710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.749913] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.749999] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.750202] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab is going to be created. [ 624.774874] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.775760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.775760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.775760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.775760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.783823] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab in Status: UNINITIALIZED for 2s [ 624.918657] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.918657] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.918657] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.919183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.919795] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.919795] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 already deleted. [ 624.919795] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.919973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.920177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.920719] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.932076] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.035279] env[69692]: INFO networking_nsxv3.common.synchronization [None req-7c97d879-487c-4732-916a-a6b7f6a35684 None None] Enqueued Resource ID: 19b4c3f9-ddd1-46b4-8d05-206d2bf169ba with Priority: HIGHEST for action port [ 625.036444] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19b4c3f9-ddd1-46b4-8d05-206d2bf169ba with Priority: HIGHEST for action port [ 625.037995] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-19b4c3f9-ddd1-46b4-8d05-206d2bf169ba taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.037995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19b4c3f9-ddd1-46b4-8d05-206d2bf169ba" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.037995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19b4c3f9-ddd1-46b4-8d05-206d2bf169ba" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.038734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19b4c3f9-ddd1-46b4-8d05-206d2bf169ba" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.039756] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19b4c3f9-ddd1-46b4-8d05-206d2bf169ba',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.434179] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0606438c-ea63-4fae-97b5-53d1cd997a59: rpc.has_security_group_logging(os_id): False [ 625.445625] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.445625] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.446202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.446202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.446202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.446202] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 already deleted. [ 625.446336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.450524] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.450726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.450726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.451610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.451610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.451610] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.451838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.451838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.451924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.452019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.452113] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 is going to be created. [ 625.517169] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.517331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.517401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.517668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.517863] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.532390] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 in Status: IN_PROGRESS for 2s [ 625.547379] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19b4c3f9-ddd1-46b4-8d05-206d2bf169ba [ 625.547940] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.547940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.547940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.548446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.548446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.548446] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19b4c3f9-ddd1-46b4-8d05-206d2bf169ba already deleted. [ 625.548959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19b4c3f9-ddd1-46b4-8d05-206d2bf169ba" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.768668] env[69692]: INFO networking_nsxv3.common.synchronization [None req-7a433e67-349b-4619-8351-fbc43fe75e70 None None] Enqueued Resource ID: 1ec0f46e-9991-45e3-a4f6-f9776f2744a7 with Priority: HIGHEST for action port [ 625.769464] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ec0f46e-9991-45e3-a4f6-f9776f2744a7 with Priority: HIGHEST for action port [ 625.770665] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ec0f46e-9991-45e3-a4f6-f9776f2744a7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.771059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ec0f46e-9991-45e3-a4f6-f9776f2744a7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.771371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ec0f46e-9991-45e3-a4f6-f9776f2744a7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.771553] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ec0f46e-9991-45e3-a4f6-f9776f2744a7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.771658] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ec0f46e-9991-45e3-a4f6-f9776f2744a7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.882982] env[69692]: INFO networking_nsxv3.common.synchronization [req-7fc5efcb-790e-4685-81b3-0eaa5e55bd47 req-53923345-5a2d-46fb-9a6c-602259fbd78f service nova] Enqueued Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGHEST for action security_group_rules [ 625.883297] env[69692]: INFO networking_nsxv3.common.synchronization [req-7fc5efcb-790e-4685-81b3-0eaa5e55bd47 req-53923345-5a2d-46fb-9a6c-602259fbd78f service nova] Enqueued Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGHEST for action security_group_members [ 625.883297] env[69692]: INFO networking_nsxv3.common.synchronization [req-7fc5efcb-790e-4685-81b3-0eaa5e55bd47 req-53923345-5a2d-46fb-9a6c-602259fbd78f service nova] Enqueued Resource ID: cd17c847-64c1-49e7-8fd9-1467d5cb193f with Priority: HIGHEST for action port [ 625.883506] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGHEST for action security_group_rules [ 625.883629] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGHEST for action security_group_members [ 625.883721] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd17c847-64c1-49e7-8fd9-1467d5cb193f with Priority: HIGHEST for action port [ 625.884273] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9ea5c0-4781-4575-9fde-6a93632303e0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.884444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.884444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.884641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.884762] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9ea5c0-4781-4575-9fde-6a93632303e0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.886564] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9ea5c0-4781-4575-9fde-6a93632303e0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.886718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.886816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.887058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.887289] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.887409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.887480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.887653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.887752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.887869] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d9ea5c0-4781-4575-9fde-6a93632303e0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.888668] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd17c847-64c1-49e7-8fd9-1467d5cb193f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.888783] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd17c847-64c1-49e7-8fd9-1467d5cb193f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.888868] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd17c847-64c1-49e7-8fd9-1467d5cb193f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.888988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd17c847-64c1-49e7-8fd9-1467d5cb193f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.894178] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd17c847-64c1-49e7-8fd9-1467d5cb193f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.276407] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ec0f46e-9991-45e3-a4f6-f9776f2744a7 [ 626.276636] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.276766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.276843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.277120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.277191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.277288] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ec0f46e-9991-45e3-a4f6-f9776f2744a7 already deleted. [ 626.277375] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ec0f46e-9991-45e3-a4f6-f9776f2744a7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.395447] env[69692]: INFO networking_nsxv3.common.synchronization [req-54b80d57-4317-4d19-aee9-dc8f6f2e1e37 req-a4d18df2-600d-44e0-a267-63939166638a tempest-VolumesAssistedSnapshotsTest-1274009765 tempest-VolumesAssistedSnapshotsTest-1274009765-project-member] Enqueued Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGHEST for action security_group_members [ 626.395447] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d9ea5c0-4781-4575-9fde-6a93632303e0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.397447] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9ea5c0-4781-4575-9fde-6a93632303e0 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.397612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.397716] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGHEST for action security_group_members [ 626.397942] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd17c847-64c1-49e7-8fd9-1467d5cb193f with status ACTIVE [ 626.398115] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.398229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.398292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.398497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.398578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.398740] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.398837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.398924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.399180] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.399391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.399491] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.399576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.399662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.400015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.400015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.404153] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd17c847-64c1-49e7-8fd9-1467d5cb193f is going to be updated. [ 626.404213] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d4ca52d-d178-4c04-a293-073162c8fb0b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.404297] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.404444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.404690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.404845] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.404933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.404993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.405155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.405233] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.405321] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d4ca52d-d178-4c04-a293-073162c8fb0b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.426810] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.426963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.427062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.427388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.428437] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.428437] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd17c847-64c1-49e7-8fd9-1467d5cb193f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.793681] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab in Status: SUCCESS [ 626.798363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.798516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.798732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.798923] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.799053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.799314] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.799314] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.799418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.799450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.799537] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab04df45-cf74-4894-8e09-dc03e4e3ecab',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.907999] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d9ea5c0-4781-4575-9fde-6a93632303e0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.909907] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.910183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.910282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.910591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.910766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.912823] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.912823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.914187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.914589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.915232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.915232] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b already deleted. [ 626.915232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.302394] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab04df45-cf74-4894-8e09-dc03e4e3ecab taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.303155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.303306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.304207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.304451] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.304662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.304774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.304988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.305159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.305320] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.305708] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab04df45-cf74-4894-8e09-dc03e4e3ecab taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.305892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.305995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.306144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.306319] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.306420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.306493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.306650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.306737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.306820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.306912] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab04df45-cf74-4894-8e09-dc03e4e3ecab',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.416215] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.416464] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.416464] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.416686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.416792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.416882] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 is going to be created. [ 627.441894] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.442117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.442209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.442517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.442682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.451255] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 in Status: UNINITIALIZED for 2s [ 627.501490] env[69692]: INFO networking_nsxv3.common.synchronization [None req-41f3b1b4-8608-485a-94f2-6471387d17f7 None None] Enqueued Resource ID: 4da119df-be58-42d7-82a3-6b91c1cff5b1 with Priority: HIGHEST for action port [ 627.501753] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da119df-be58-42d7-82a3-6b91c1cff5b1 with Priority: HIGHEST for action port [ 627.502328] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-4da119df-be58-42d7-82a3-6b91c1cff5b1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.502517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4da119df-be58-42d7-82a3-6b91c1cff5b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.502629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4da119df-be58-42d7-82a3-6b91c1cff5b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.502926] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4da119df-be58-42d7-82a3-6b91c1cff5b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.504271] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4da119df-be58-42d7-82a3-6b91c1cff5b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.546247] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 in Status: SUCCESS [ 627.546466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.590890] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-883 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.591115] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-883" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.591245] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-883" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.591616] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-883" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.591878] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.596871] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.596871] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.596871] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.596871] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.596871] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.596871] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.596871] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.596871] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.596871] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.596871] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.596871] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.618202] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.618399] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 627.618515] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.618698] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-883" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.619076] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-09248364-f8db-4915-ae6e-596338b4404a taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.619231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-09248364-f8db-4915-ae6e-596338b4404a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.620860] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-09248364-f8db-4915-ae6e-596338b4404a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.620860] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-09248364-f8db-4915-ae6e-596338b4404a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.620860] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09248364-f8db-4915-ae6e-596338b4404a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.812618] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab04df45-cf74-4894-8e09-dc03e4e3ecab: rpc.has_security_group_logging(os_id): False [ 627.833221] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.833221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.833221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.833221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.833549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.833549] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.833649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.833693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.838163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.838320] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.838585] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.838694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.838755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.838946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.839038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.839255] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.839346] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.839952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.839952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.839952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.839952] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab is going to be created. [ 627.912060] env[69692]: INFO networking_nsxv3.common.synchronization [req-74bf3475-11c2-456a-8077-e01c751d89ac req-0ccace06-8fbd-4b3f-ae82-abe3e8918c95 tempest-AttachInterfacesV270Test-589166570 tempest-AttachInterfacesV270Test-589166570-project-member] Enqueued Resource ID: b57d8773-fb88-48dd-8778-aad060b75558 with Priority: HIGHEST for action security_group_members [ 627.915746] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.916459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.916591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.916843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.917444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.918921] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b57d8773-fb88-48dd-8778-aad060b75558 with Priority: HIGHEST for action security_group_members [ 627.922042] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b57d8773-fb88-48dd-8778-aad060b75558 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.922211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.922246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.922568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.922637] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.922874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.922874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.922941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.923043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.923185] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b57d8773-fb88-48dd-8778-aad060b75558',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.937707] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab in Status: IN_PROGRESS for 2s [ 628.006038] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4da119df-be58-42d7-82a3-6b91c1cff5b1 [ 628.006140] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.006284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.006348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.006582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.007000] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.007000] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4da119df-be58-42d7-82a3-6b91c1cff5b1 already deleted. [ 628.007000] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4da119df-be58-42d7-82a3-6b91c1cff5b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.127582] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.128059] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.128320] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.128725] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.129784] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.130141] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 09248364-f8db-4915-ae6e-596338b4404a not found, creating... [ 628.130591] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.130918] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.131384] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.131840] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.132105] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.132535] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.134767] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.134767] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.134767] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.134767] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.134767] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 09248364-f8db-4915-ae6e-596338b4404a is going to be created. [ 628.164492] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.164723] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.164903] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.165121] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.165352] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.165597] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-09248364-f8db-4915-ae6e-596338b4404a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.426339] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.426494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.426559] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.426783] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.427043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.427116] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.427194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.427299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.427415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.427494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.427696] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b57d8773-fb88-48dd-8778-aad060b75558 is going to be updated. [ 628.453692] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.453895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.453986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.454455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.454598] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.463701] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b57d8773-fb88-48dd-8778-aad060b75558 in Status: IN_PROGRESS for 2s [ 629.199301] env[69692]: INFO networking_nsxv3.common.synchronization [req-54b80d57-4317-4d19-aee9-dc8f6f2e1e37 req-0582f0c2-42b6-4662-a836-e349a498122f service nova] Enqueued Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGHEST for action security_group_rules [ 629.199301] env[69692]: INFO networking_nsxv3.common.synchronization [req-54b80d57-4317-4d19-aee9-dc8f6f2e1e37 req-0582f0c2-42b6-4662-a836-e349a498122f service nova] Enqueued Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGHEST for action security_group_members [ 629.199301] env[69692]: INFO networking_nsxv3.common.synchronization [req-54b80d57-4317-4d19-aee9-dc8f6f2e1e37 req-0582f0c2-42b6-4662-a836-e349a498122f service nova] Enqueued Resource ID: 09248364-f8db-4915-ae6e-596338b4404a with Priority: HIGHEST for action port [ 629.200605] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGHEST for action security_group_rules [ 629.200605] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGHEST for action security_group_members [ 629.200605] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09248364-f8db-4915-ae6e-596338b4404a with Priority: HIGHEST for action port [ 629.201803] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d4ca52d-d178-4c04-a293-073162c8fb0b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.202084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.202141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.203111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.203189] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d4ca52d-d178-4c04-a293-073162c8fb0b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.206310] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d4ca52d-d178-4c04-a293-073162c8fb0b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.206431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.206524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.206688] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.206881] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.206950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.207333] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.207536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.207642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.208106] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d4ca52d-d178-4c04-a293-073162c8fb0b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.210407] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-09248364-f8db-4915-ae6e-596338b4404a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.210407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09248364-f8db-4915-ae6e-596338b4404a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.210575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09248364-f8db-4915-ae6e-596338b4404a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.210767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09248364-f8db-4915-ae6e-596338b4404a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.210875] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09248364-f8db-4915-ae6e-596338b4404a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.342583] env[69692]: INFO networking_nsxv3.common.synchronization [None req-135d25d0-c65e-4601-91a5-374046427112 None None] Enqueued Resource ID: c62fb17e-ab7e-475b-8ed3-ba0121de0662 with Priority: HIGHEST for action port [ 629.342843] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c62fb17e-ab7e-475b-8ed3-ba0121de0662 with Priority: HIGHEST for action port [ 629.348334] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-c62fb17e-ab7e-475b-8ed3-ba0121de0662 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.348334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c62fb17e-ab7e-475b-8ed3-ba0121de0662" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.348334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c62fb17e-ab7e-475b-8ed3-ba0121de0662" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.348334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c62fb17e-ab7e-475b-8ed3-ba0121de0662" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.348334] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c62fb17e-ab7e-475b-8ed3-ba0121de0662',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.462801] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 in Status: SUCCESS [ 629.463215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.463495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.463921] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.464246] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.464416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.464523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.464727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.465072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.465224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.465386] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d9ea5c0-4781-4575-9fde-6a93632303e0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.710467] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d4ca52d-d178-4c04-a293-073162c8fb0b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.712964] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d4ca52d-d178-4c04-a293-073162c8fb0b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.713156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.715088] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09248364-f8db-4915-ae6e-596338b4404a with status ACTIVE [ 629.715088] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.715088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.715088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.715088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.715088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.715088] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.715088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.715088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.715088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.715088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.715088] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.715088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.715088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.715088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.715088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.715088] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09248364-f8db-4915-ae6e-596338b4404a is going to be updated. [ 629.734847] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.735012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.735159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.735435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.735523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.735726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09248364-f8db-4915-ae6e-596338b4404a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.850257] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c62fb17e-ab7e-475b-8ed3-ba0121de0662 [ 629.850525] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.850671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.850731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.850936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.851614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.851757] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c62fb17e-ab7e-475b-8ed3-ba0121de0662 already deleted. [ 629.851864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c62fb17e-ab7e-475b-8ed3-ba0121de0662" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.949516] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab in Status: SUCCESS [ 629.950063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.967589] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d9ea5c0-4781-4575-9fde-6a93632303e0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.212629] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d4ca52d-d178-4c04-a293-073162c8fb0b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.469926] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d9ea5c0-4781-4575-9fde-6a93632303e0: rpc.has_security_group_logging(os_id): False [ 630.477036] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b57d8773-fb88-48dd-8778-aad060b75558 in Status: SUCCESS [ 630.477290] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b57d8773-fb88-48dd-8778-aad060b75558 deletion is rescheduled due to dependency. [ 630.477424] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.489066] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.489310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.489923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.489923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.489923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.490119] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.490119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.490215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.490422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.490497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.490584] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 is going to be created. [ 630.547537] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.547693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.547745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.547959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.548302] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.562043] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 in Status: IN_PROGRESS for 2s [ 630.715709] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.715915] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.715967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.716187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.716331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.716395] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b is going to be created. [ 630.739977] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.740146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.740224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.740676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.740676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.749191] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b in Status: UNINITIALIZED for 2s [ 632.061988] env[69692]: INFO networking_nsxv3.common.synchronization [req-7e778fc4-57a3-4bc3-bbd1-fc6bcbf79c7f req-10f71438-0049-45b6-a096-e8b02b9e8e82 tempest-ServerExternalEventsTest-1529359532 tempest-ServerExternalEventsTest-1529359532-project-member] Enqueued Resource ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 with Priority: HIGHEST for action security_group_members [ 632.062843] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 with Priority: HIGHEST for action security_group_members [ 632.063232] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ef05655-0d1f-4345-946e-e5a87b85a408 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.063408] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.063575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.064238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.064605] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.064749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.065136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.065398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.065556] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.065726] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ef05655-0d1f-4345-946e-e5a87b85a408',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.573583] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.573583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.573583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.573583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.573583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.573583] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.573583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.573583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.573583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.573583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.573583] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 is going to be updated. [ 632.575778] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 in Status: SUCCESS [ 632.575972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.601172] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.601323] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.601387] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.601606] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.601753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.609482] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 in Status: IN_PROGRESS for 2s [ 632.762032] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b in Status: SUCCESS [ 632.762032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.762032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.762032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.762032] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.762032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.762032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.762032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.762032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.762032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.762032] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d4ca52d-d178-4c04-a293-073162c8fb0b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.043145] env[69692]: INFO networking_nsxv3.common.synchronization [None req-de497a29-c130-4923-9307-d2897d60364f None None] Enqueued Resource ID: d945f817-8de3-4e69-9be2-a1cf072d12f2 with Priority: HIGHEST for action port [ 633.044016] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d945f817-8de3-4e69-9be2-a1cf072d12f2 with Priority: HIGHEST for action port [ 633.044016] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-d945f817-8de3-4e69-9be2-a1cf072d12f2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.045175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d945f817-8de3-4e69-9be2-a1cf072d12f2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.045175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d945f817-8de3-4e69-9be2-a1cf072d12f2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.045175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d945f817-8de3-4e69-9be2-a1cf072d12f2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.045364] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d945f817-8de3-4e69-9be2-a1cf072d12f2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.269756] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d4ca52d-d178-4c04-a293-073162c8fb0b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.548408] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d945f817-8de3-4e69-9be2-a1cf072d12f2 [ 633.548408] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.548408] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.549105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.549105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.549105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.549105] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d945f817-8de3-4e69-9be2-a1cf072d12f2 already deleted. [ 633.549105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d945f817-8de3-4e69-9be2-a1cf072d12f2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.771233] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d4ca52d-d178-4c04-a293-073162c8fb0b: rpc.has_security_group_logging(os_id): False [ 633.790766] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.790766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.790766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.790766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.790766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.790766] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.790766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.790766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.790766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.790766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.790766] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b is going to be created. [ 633.851721] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.851885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.851933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.852176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.852354] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.862583] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b in Status: IN_PROGRESS for 2s [ 634.435550] env[69692]: INFO networking_nsxv3.common.synchronization [None req-c88a710b-e92b-4337-8da3-96bca564af40 None None] Enqueued Resource ID: 92c0fcb9-8d19-475b-bce9-081355931b6d with Priority: HIGHEST for action port [ 634.435805] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92c0fcb9-8d19-475b-bce9-081355931b6d with Priority: HIGHEST for action port [ 634.436348] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-92c0fcb9-8d19-475b-bce9-081355931b6d taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.436625] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92c0fcb9-8d19-475b-bce9-081355931b6d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.436625] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92c0fcb9-8d19-475b-bce9-081355931b6d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.436790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92c0fcb9-8d19-475b-bce9-081355931b6d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.436944] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92c0fcb9-8d19-475b-bce9-081355931b6d',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.620601] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 in Status: SUCCESS [ 634.620790] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 deletion is rescheduled due to dependency. [ 634.621392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.939205] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92c0fcb9-8d19-475b-bce9-081355931b6d [ 634.940842] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.940842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.940842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.940842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.940842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.940842] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92c0fcb9-8d19-475b-bce9-081355931b6d already deleted. [ 634.940842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92c0fcb9-8d19-475b-bce9-081355931b6d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.760204] env[69692]: INFO networking_nsxv3.common.synchronization [None req-da96896e-444f-43fb-b1a9-3773c180398f None None] Enqueued Resource ID: 48dd926a-2481-4cef-b152-8b4581c6aeec with Priority: HIGHEST for action port [ 635.760204] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48dd926a-2481-4cef-b152-8b4581c6aeec with Priority: HIGHEST for action port [ 635.762051] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-48dd926a-2481-4cef-b152-8b4581c6aeec taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.762051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48dd926a-2481-4cef-b152-8b4581c6aeec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.762051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48dd926a-2481-4cef-b152-8b4581c6aeec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.764106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48dd926a-2481-4cef-b152-8b4581c6aeec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.764106] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48dd926a-2481-4cef-b152-8b4581c6aeec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.875506] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b in Status: SUCCESS [ 635.875761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.267717] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48dd926a-2481-4cef-b152-8b4581c6aeec [ 636.267717] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.267717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.267717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.267717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.267717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.267717] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48dd926a-2481-4cef-b152-8b4581c6aeec already deleted. [ 636.267717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48dd926a-2481-4cef-b152-8b4581c6aeec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.166578] env[69692]: INFO networking_nsxv3.common.synchronization [None req-144baa91-0af5-49e7-899e-2e35f32fab63 None None] Enqueued Resource ID: ac126816-8e8f-41b7-8263-41591e1f7d03 with Priority: HIGHEST for action port [ 637.167097] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac126816-8e8f-41b7-8263-41591e1f7d03 with Priority: HIGHEST for action port [ 637.167410] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac126816-8e8f-41b7-8263-41591e1f7d03 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.167526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac126816-8e8f-41b7-8263-41591e1f7d03" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.167592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac126816-8e8f-41b7-8263-41591e1f7d03" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.168359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac126816-8e8f-41b7-8263-41591e1f7d03" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.168650] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac126816-8e8f-41b7-8263-41591e1f7d03',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.241027] env[69692]: INFO networking_nsxv3.common.synchronization [None req-2c34bcc9-645b-4f85-8f46-27c02c2ec97f None None] Enqueued Resource ID: 69137894-e339-427d-ade0-072d95b29cb1 with Priority: HIGHEST for action port [ 637.241027] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69137894-e339-427d-ade0-072d95b29cb1 with Priority: HIGHEST for action port [ 637.241027] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-69137894-e339-427d-ade0-072d95b29cb1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.241027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69137894-e339-427d-ade0-072d95b29cb1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.241027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69137894-e339-427d-ade0-072d95b29cb1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.241027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69137894-e339-427d-ade0-072d95b29cb1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.241027] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69137894-e339-427d-ade0-072d95b29cb1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.661752] env[69692]: INFO networking_nsxv3.common.synchronization [req-4719fd34-e6d4-4dc5-ac06-238d6fe0d885 req-bd8f7469-79c4-4ce0-8cc3-e497211e8376 tempest-InstanceActionsV221TestJSON-2110776459 tempest-InstanceActionsV221TestJSON-2110776459-project-member] Enqueued Resource ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab with Priority: HIGHEST for action security_group_members [ 637.661752] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab with Priority: HIGHEST for action security_group_members [ 637.661752] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab04df45-cf74-4894-8e09-dc03e4e3ecab taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.661752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.661752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.662029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.662029] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.663044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.663191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.663282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.663376] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.663503] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab04df45-cf74-4894-8e09-dc03e4e3ecab',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.671306] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac126816-8e8f-41b7-8263-41591e1f7d03 [ 637.671476] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.671578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.671649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.671890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.671974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.672219] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac126816-8e8f-41b7-8263-41591e1f7d03 already deleted. [ 637.672219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac126816-8e8f-41b7-8263-41591e1f7d03" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.748460] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69137894-e339-427d-ade0-072d95b29cb1 [ 637.748624] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.748761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.748833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.749065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.749158] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.749254] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69137894-e339-427d-ade0-072d95b29cb1 already deleted. [ 637.749389] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69137894-e339-427d-ade0-072d95b29cb1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.167787] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.168119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.168119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.168257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.168352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.168545] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.168647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.168694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.168857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.168937] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.169035] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab is going to be updated. [ 638.199101] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.199361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.199444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.199607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.199754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.208099] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab in Status: IN_PROGRESS for 2s [ 639.890802] env[69692]: INFO networking_nsxv3.common.synchronization [None req-eaa4105a-ddd2-4a97-80e7-e791f327a7f3 None None] Enqueued Resource ID: 2f2410f3-f6c5-4487-b546-229b557de995 with Priority: HIGHEST for action port [ 639.891549] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f2410f3-f6c5-4487-b546-229b557de995 with Priority: HIGHEST for action port [ 639.892024] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f2410f3-f6c5-4487-b546-229b557de995 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.892226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f2410f3-f6c5-4487-b546-229b557de995" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.892328] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f2410f3-f6c5-4487-b546-229b557de995" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.892590] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f2410f3-f6c5-4487-b546-229b557de995" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.892675] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f2410f3-f6c5-4487-b546-229b557de995',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.021049] env[69692]: INFO networking_nsxv3.common.synchronization [None req-32559dc7-6d71-4d83-a482-ead5985437a4 None None] Enqueued Resource ID: ff774c0a-19e3-4ec2-8456-176e24d0b755 with Priority: HIGHEST for action port [ 640.021307] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff774c0a-19e3-4ec2-8456-176e24d0b755 with Priority: HIGHEST for action port [ 640.022060] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff774c0a-19e3-4ec2-8456-176e24d0b755 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.023115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff774c0a-19e3-4ec2-8456-176e24d0b755" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.023115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff774c0a-19e3-4ec2-8456-176e24d0b755" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.023115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff774c0a-19e3-4ec2-8456-176e24d0b755" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.023115] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff774c0a-19e3-4ec2-8456-176e24d0b755',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.127367] env[69692]: INFO networking_nsxv3.common.synchronization [req-840ca579-d3b5-4763-bb69-3b9817085225 req-41d6e30d-ffb2-4a6c-9287-e00046ccc46e tempest-FloatingIPsAssociationNegativeTestJSON-1148568605 tempest-FloatingIPsAssociationNegativeTestJSON-1148568605-project-member] Enqueued Resource ID: beac83ef-5694-434f-9cdc-fd976212be41 with Priority: HIGHEST for action security_group_members [ 640.127367] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beac83ef-5694-434f-9cdc-fd976212be41 with Priority: HIGHEST for action security_group_members [ 640.127367] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-beac83ef-5694-434f-9cdc-fd976212be41 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.127367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.127367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.127367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.128205] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.128545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.128726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.129020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.129218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.129454] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('beac83ef-5694-434f-9cdc-fd976212be41',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.218614] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab in Status: SUCCESS [ 640.218614] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab04df45-cf74-4894-8e09-dc03e4e3ecab deletion is rescheduled due to dependency. [ 640.218614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab04df45-cf74-4894-8e09-dc03e4e3ecab" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.396413] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f2410f3-f6c5-4487-b546-229b557de995 [ 640.398154] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.398422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.398536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.398835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.398991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.399149] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f2410f3-f6c5-4487-b546-229b557de995 already deleted. [ 640.399272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f2410f3-f6c5-4487-b546-229b557de995" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.525842] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff774c0a-19e3-4ec2-8456-176e24d0b755 [ 640.526242] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.526553] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.526791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.527597] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.527804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.527990] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff774c0a-19e3-4ec2-8456-176e24d0b755 already deleted. [ 640.528178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff774c0a-19e3-4ec2-8456-176e24d0b755" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.632395] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.632561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.632686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.632949] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.633117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.633258] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.633363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.633422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.633572] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.633643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.633734] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beac83ef-5694-434f-9cdc-fd976212be41 is going to be updated. [ 640.658483] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.658858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.661039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.661039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.661039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.670337] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beac83ef-5694-434f-9cdc-fd976212be41 in Status: IN_PROGRESS for 2s [ 642.049087] env[69692]: INFO networking_nsxv3.common.synchronization [None req-a99a2db7-e1ea-4d43-9aba-07c06a09f8a7 None None] Enqueued Resource ID: b67c9633-58ed-4b93-ab7d-51d583842f56 with Priority: HIGHEST for action port [ 642.049317] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b67c9633-58ed-4b93-ab7d-51d583842f56 with Priority: HIGHEST for action port [ 642.049938] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-b67c9633-58ed-4b93-ab7d-51d583842f56 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.050082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b67c9633-58ed-4b93-ab7d-51d583842f56" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.050152] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b67c9633-58ed-4b93-ab7d-51d583842f56" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.050483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b67c9633-58ed-4b93-ab7d-51d583842f56" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.050585] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b67c9633-58ed-4b93-ab7d-51d583842f56',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.559057] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b67c9633-58ed-4b93-ab7d-51d583842f56 [ 642.559057] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.559057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.559057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.559057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.559366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.559366] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b67c9633-58ed-4b93-ab7d-51d583842f56 already deleted. [ 642.559366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b67c9633-58ed-4b93-ab7d-51d583842f56" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.681120] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: beac83ef-5694-434f-9cdc-fd976212be41 in Status: SUCCESS [ 642.681328] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: beac83ef-5694-434f-9cdc-fd976212be41 deletion is rescheduled due to dependency. [ 642.681419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.445946] env[69692]: INFO networking_nsxv3.common.synchronization [None req-01642c28-ead7-4efa-b465-d991b46802ad None None] Enqueued Resource ID: a98b55c7-f745-47b5-97c8-97d48a662eff with Priority: HIGHEST for action port [ 645.446255] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a98b55c7-f745-47b5-97c8-97d48a662eff with Priority: HIGHEST for action port [ 645.446331] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-a98b55c7-f745-47b5-97c8-97d48a662eff taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.446393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a98b55c7-f745-47b5-97c8-97d48a662eff" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.446475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a98b55c7-f745-47b5-97c8-97d48a662eff" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.446748] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a98b55c7-f745-47b5-97c8-97d48a662eff" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.446837] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a98b55c7-f745-47b5-97c8-97d48a662eff',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.951296] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a98b55c7-f745-47b5-97c8-97d48a662eff [ 645.951296] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.951296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.951296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.951296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.951296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.951296] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a98b55c7-f745-47b5-97c8-97d48a662eff already deleted. [ 645.951296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a98b55c7-f745-47b5-97c8-97d48a662eff" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.480138] env[69692]: INFO networking_nsxv3.common.synchronization [None req-915ff872-55b1-4130-8e69-28a1ce608105 tempest-AttachVolumeShelveTestJSON-1120054663 tempest-AttachVolumeShelveTestJSON-1120054663-project-member] Enqueued Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_rules [ 646.480898] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_rules [ 646.481220] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-859b640d-3815-457c-8a5b-e9eee00dbcee taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.481337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.481407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.484565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.484565] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.665082] env[69692]: INFO networking_nsxv3.common.synchronization [None req-c70a027e-89a0-42ff-a5ad-f25792c6b142 tempest-AttachVolumeShelveTestJSON-1120054663 tempest-AttachVolumeShelveTestJSON-1120054663-project-member] Enqueued Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_rules [ 646.665640] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_rules [ 646.667351] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-859b640d-3815-457c-8a5b-e9eee00dbcee taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.667548] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.011065] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.011065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.011065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.011065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.011065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.011065] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 859b640d-3815-457c-8a5b-e9eee00dbcee already deleted. [ 647.011065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.011065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.011446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.011446] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.377701] env[69692]: INFO networking_nsxv3.common.synchronization [req-cb1e5b98-db2a-4d13-986a-1ed3bd0c05bf req-b7f306a0-8aae-4076-9cd3-38960508d25e tempest-ServersWithSpecificFlavorTestJSON-467341840 tempest-ServersWithSpecificFlavorTestJSON-467341840-project-member] Enqueued Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_members [ 647.378497] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_members [ 647.379016] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.382534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.382534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.382534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.382534] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.382534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.382534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.382534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.382534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.382534] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.533912] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.534257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.534257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.534411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.534454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.534541] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 859b640d-3815-457c-8a5b-e9eee00dbcee already deleted. [ 647.534623] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.630605] env[69692]: INFO networking_nsxv3.common.synchronization [None req-98c558d4-e1d1-4ca6-aa1c-4358c178312a None None] Enqueued Resource ID: 77872b28-9605-498d-9fda-c357e1bd7a45 with Priority: HIGHEST for action port [ 647.630605] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77872b28-9605-498d-9fda-c357e1bd7a45 with Priority: HIGHEST for action port [ 647.630968] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-77872b28-9605-498d-9fda-c357e1bd7a45 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.631068] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77872b28-9605-498d-9fda-c357e1bd7a45" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.631103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77872b28-9605-498d-9fda-c357e1bd7a45" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.631346] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77872b28-9605-498d-9fda-c357e1bd7a45" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.631429] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77872b28-9605-498d-9fda-c357e1bd7a45',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.883983] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.884461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.884461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.884702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.884797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.885025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.885133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.885198] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.885367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.885479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.885520] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 already deleted. [ 647.885603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.137033] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77872b28-9605-498d-9fda-c357e1bd7a45 [ 648.137281] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.137473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.137777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.137777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.137868] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.137942] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77872b28-9605-498d-9fda-c357e1bd7a45 already deleted. [ 648.138039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77872b28-9605-498d-9fda-c357e1bd7a45" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.440612] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.440864] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-460" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.441121] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-460" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.441359] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-460" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.441637] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.441803] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.441922] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.442180] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.442322] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.442536] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.442652] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.442762] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.442893] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.442982] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.443182] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.443233] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.462666] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.462666] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 648.462666] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.462829] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-460" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.463169] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-563082a5-0600-4359-bc0d-daa3fe36fbdb taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.463355] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-563082a5-0600-4359-bc0d-daa3fe36fbdb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.463479] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-563082a5-0600-4359-bc0d-daa3fe36fbdb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.463836] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-563082a5-0600-4359-bc0d-daa3fe36fbdb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.463979] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('563082a5-0600-4359-bc0d-daa3fe36fbdb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.968052] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.968052] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.968052] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.968052] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.968052] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.968052] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 563082a5-0600-4359-bc0d-daa3fe36fbdb not found, creating... [ 648.968052] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.968052] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.968052] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.968052] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.968052] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.968694] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.968694] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.968694] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.968694] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.968694] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.968874] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 563082a5-0600-4359-bc0d-daa3fe36fbdb is going to be created. [ 648.989076] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.989076] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.989076] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.989076] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.990366] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.990778] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-563082a5-0600-4359-bc0d-daa3fe36fbdb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.012112] env[69692]: INFO networking_nsxv3.common.synchronization [None req-c140fce7-496d-4887-a296-b53eb6326342 None None] Enqueued Resource ID: 23973e02-f9cc-4562-bf3e-15acc8ac2058 with Priority: HIGHEST for action port [ 649.012623] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23973e02-f9cc-4562-bf3e-15acc8ac2058 with Priority: HIGHEST for action port [ 649.012929] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-23973e02-f9cc-4562-bf3e-15acc8ac2058 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.013065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23973e02-f9cc-4562-bf3e-15acc8ac2058" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.013139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23973e02-f9cc-4562-bf3e-15acc8ac2058" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.013416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23973e02-f9cc-4562-bf3e-15acc8ac2058" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.013483] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23973e02-f9cc-4562-bf3e-15acc8ac2058',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.515789] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23973e02-f9cc-4562-bf3e-15acc8ac2058 [ 649.516035] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.516169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.516240] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.516460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.516551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.516705] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23973e02-f9cc-4562-bf3e-15acc8ac2058 already deleted. [ 649.516759] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23973e02-f9cc-4562-bf3e-15acc8ac2058" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.001854] env[69692]: INFO networking_nsxv3.common.synchronization [req-cb1e5b98-db2a-4d13-986a-1ed3bd0c05bf req-eafb9726-fd81-4f16-b648-960e31065b8e service nova] Enqueued Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_rules [ 650.001854] env[69692]: INFO networking_nsxv3.common.synchronization [req-cb1e5b98-db2a-4d13-986a-1ed3bd0c05bf req-eafb9726-fd81-4f16-b648-960e31065b8e service nova] Enqueued Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_members [ 650.001854] env[69692]: INFO networking_nsxv3.common.synchronization [req-cb1e5b98-db2a-4d13-986a-1ed3bd0c05bf req-eafb9726-fd81-4f16-b648-960e31065b8e service nova] Enqueued Resource ID: 563082a5-0600-4359-bc0d-daa3fe36fbdb with Priority: HIGHEST for action port [ 650.001854] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_rules [ 650.002791] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_members [ 650.002791] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563082a5-0600-4359-bc0d-daa3fe36fbdb with Priority: HIGHEST for action port [ 650.002791] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.002791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.002791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.003022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.007185] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.007185] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.007185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.007185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.007185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.007185] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.007185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.007185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.007185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.007185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.007185] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.007185] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-563082a5-0600-4359-bc0d-daa3fe36fbdb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.007185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-563082a5-0600-4359-bc0d-daa3fe36fbdb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.007185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-563082a5-0600-4359-bc0d-daa3fe36fbdb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.007185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-563082a5-0600-4359-bc0d-daa3fe36fbdb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.007185] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('563082a5-0600-4359-bc0d-daa3fe36fbdb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.021465] env[69692]: INFO networking_nsxv3.common.synchronization [req-343947cd-d57d-4803-8ea5-17d6f26bedf6 req-d1521b9f-09af-4d31-9f58-2c8232baf44b tempest-ListImageFiltersTestJSON-1628776345 tempest-ListImageFiltersTestJSON-1628776345-project-member] Enqueued Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_members [ 650.022170] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_members [ 650.022495] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.022639] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.022686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.022948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.023714] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.023810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.023973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.025352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.025352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.027107] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.405055] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.405055] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.405055] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.405055] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.405055] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.405454] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.405679] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.405979] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.406237] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.406788] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.406997] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.407268] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.407494] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.407748] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.407986] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.408267] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.429253] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.429253] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 650.429253] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.429253] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.429253] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-d84e7670-1db6-4cc8-a219-5869b025b2ef taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.429253] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-d84e7670-1db6-4cc8-a219-5869b025b2ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.429253] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-d84e7670-1db6-4cc8-a219-5869b025b2ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.429253] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-d84e7670-1db6-4cc8-a219-5869b025b2ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.429253] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d84e7670-1db6-4cc8-a219-5869b025b2ef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.510602] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 563082a5-0600-4359-bc0d-daa3fe36fbdb with status ACTIVE [ 650.514120] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.514120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.514120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.514120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.514120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.514443] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.514443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.514443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.514856] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.514856] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.514856] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.515177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.515177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.515177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.515177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.515384] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 563082a5-0600-4359-bc0d-daa3fe36fbdb is going to be updated. [ 650.517473] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.518737] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.519144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.530210] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.530404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.530478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.530832] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.530956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.531415] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.531564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.531634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.531993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.532276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.532374] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 already deleted. [ 650.532456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.537791] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.537920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.537961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.538181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.538292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.538438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-563082a5-0600-4359-bc0d-daa3fe36fbdb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.573297] env[69692]: INFO networking_nsxv3.common.synchronization [None req-2299ee6d-e650-4a80-aae8-820a0532ef32 None None] Enqueued Resource ID: a1612f80-6821-4f31-ac4c-06cad723f453 with Priority: HIGHEST for action port [ 650.573297] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1612f80-6821-4f31-ac4c-06cad723f453 with Priority: HIGHEST for action port [ 650.573297] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1612f80-6821-4f31-ac4c-06cad723f453 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.573297] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1612f80-6821-4f31-ac4c-06cad723f453" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.573297] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1612f80-6821-4f31-ac4c-06cad723f453" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.573297] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1612f80-6821-4f31-ac4c-06cad723f453" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.573297] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1612f80-6821-4f31-ac4c-06cad723f453',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.916206] env[69692]: INFO networking_nsxv3.common.synchronization [None req-c54d434a-eb13-472e-948c-449d6de3c863 None None] Enqueued Resource ID: 74d1df18-3fac-44ab-bfbc-befd001fa416 with Priority: HIGHEST for action port [ 650.916468] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74d1df18-3fac-44ab-bfbc-befd001fa416 with Priority: HIGHEST for action port [ 650.917035] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-74d1df18-3fac-44ab-bfbc-befd001fa416 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.917446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74d1df18-3fac-44ab-bfbc-befd001fa416" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.917534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74d1df18-3fac-44ab-bfbc-befd001fa416" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.917771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74d1df18-3fac-44ab-bfbc-befd001fa416" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.917847] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74d1df18-3fac-44ab-bfbc-befd001fa416',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.932382] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.932684] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.932742] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.933171] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.933239] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.935036] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port d84e7670-1db6-4cc8-a219-5869b025b2ef not found, creating... [ 650.935036] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.935036] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.935036] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.935036] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.935036] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.935036] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.935036] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.935036] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.938484] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.938484] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.938484] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: d84e7670-1db6-4cc8-a219-5869b025b2ef is going to be created. [ 650.959211] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.959430] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.959586] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.959866] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.960114] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.960335] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-d84e7670-1db6-4cc8-a219-5869b025b2ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.021180] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.081394] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1612f80-6821-4f31-ac4c-06cad723f453 [ 651.081636] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.081798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.081864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.082088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.082172] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.082261] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1612f80-6821-4f31-ac4c-06cad723f453 already deleted. [ 651.082339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1612f80-6821-4f31-ac4c-06cad723f453" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.420958] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74d1df18-3fac-44ab-bfbc-befd001fa416 [ 651.421221] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.421391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.421430] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.421633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.421725] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.421817] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74d1df18-3fac-44ab-bfbc-befd001fa416 already deleted. [ 651.421898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74d1df18-3fac-44ab-bfbc-befd001fa416" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.525820] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.525820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.525820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.525820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.525820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.525820] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 is going to be created. [ 651.547047] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.547298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.547298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.547512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.547673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.560082] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 in Status: UNINITIALIZED for 2s [ 651.958235] env[69692]: INFO networking_nsxv3.common.synchronization [req-343947cd-d57d-4803-8ea5-17d6f26bedf6 req-0973e01c-7f42-4a0b-8d10-637459dc319c service nova] Enqueued Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_rules [ 651.961272] env[69692]: INFO networking_nsxv3.common.synchronization [req-343947cd-d57d-4803-8ea5-17d6f26bedf6 req-0973e01c-7f42-4a0b-8d10-637459dc319c service nova] Enqueued Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_members [ 651.961272] env[69692]: INFO networking_nsxv3.common.synchronization [req-343947cd-d57d-4803-8ea5-17d6f26bedf6 req-0973e01c-7f42-4a0b-8d10-637459dc319c service nova] Enqueued Resource ID: d84e7670-1db6-4cc8-a219-5869b025b2ef with Priority: HIGHEST for action port [ 651.961272] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_rules [ 651.961272] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_members [ 651.961272] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84e7670-1db6-4cc8-a219-5869b025b2ef with Priority: HIGHEST for action port [ 651.961272] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.961828] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.961828] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.961828] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.961828] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.962585] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.963510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.963510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.963510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.963510] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.963510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.963510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.963510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.963510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.963510] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.965244] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-d84e7670-1db6-4cc8-a219-5869b025b2ef taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.965244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d84e7670-1db6-4cc8-a219-5869b025b2ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.965244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d84e7670-1db6-4cc8-a219-5869b025b2ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.965244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d84e7670-1db6-4cc8-a219-5869b025b2ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.965244] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d84e7670-1db6-4cc8-a219-5869b025b2ef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.467448] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.467979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.467979] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.469028] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d84e7670-1db6-4cc8-a219-5869b025b2ef with status ACTIVE [ 652.469213] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.469324] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.469390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.469646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.469738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.469913] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.472116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.472241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.472433] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.472524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.472824] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.472947] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.473018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.473181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.473260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.473346] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d84e7670-1db6-4cc8-a219-5869b025b2ef is going to be updated. [ 652.493427] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.493584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.493651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.493847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.493975] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.494156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d84e7670-1db6-4cc8-a219-5869b025b2ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.975767] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.479990] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.480283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.480283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.480462] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.480552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.480665] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 is going to be created. [ 653.505527] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.505677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.505802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.506102] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.506170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.516334] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: UNINITIALIZED for 2s [ 653.569890] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 in Status: SUCCESS [ 653.569890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.569890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.570085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.570165] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.570230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.570302] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.570480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.570568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.570682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.570771] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.821988] env[69692]: INFO networking_nsxv3.common.synchronization [req-c02b8522-46ec-4a72-a5c2-19bfdef4e864 req-8b808a23-c3ce-49da-8e67-18239e1edc1e tempest-ServersAdminNegativeTestJSON-1244089969 tempest-ServersAdminNegativeTestJSON-1244089969-project-member] Enqueued Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_members [ 653.822288] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_members [ 653.822616] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.822746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.822814] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.825582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.825582] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.825582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.825582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.825786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.825786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.825845] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.073294] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.280649] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.280774] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.280915] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.281217] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.281499] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.281660] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.281789] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.283361] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.283865] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.283865] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.284030] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.284146] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.284252] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.284368] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.284472] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.284690] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.305868] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.306058] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 654.306199] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.306376] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.306689] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-f476f6c8-d91f-42a2-b79a-39c5c22a437d taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.306865] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-f476f6c8-d91f-42a2-b79a-39c5c22a437d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.306987] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-f476f6c8-d91f-42a2-b79a-39c5c22a437d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.307343] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-f476f6c8-d91f-42a2-b79a-39c5c22a437d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.307489] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f476f6c8-d91f-42a2-b79a-39c5c22a437d',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.327985] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.328166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.328234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.328457] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.328543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.328745] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.328836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.328920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.329047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.329121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.329310] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92949372-ad62-4c3b-ab83-73cb755bd4de already deleted. [ 654.329310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.580327] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcf8de7e-6145-413a-bbc2-af3db93cdf58: rpc.has_security_group_logging(os_id): False [ 654.598095] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.598372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.598481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.599110] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.599272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.599675] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.599843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.600018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.600228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.600369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.600505] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 is going to be created. [ 654.659275] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.659455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.659597] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.659855] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.660164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.675693] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 in Status: IN_PROGRESS for 2s [ 654.809695] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.809927] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.810085] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.810361] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.810510] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.810664] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port f476f6c8-d91f-42a2-b79a-39c5c22a437d not found, creating... [ 654.810913] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.811081] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.811197] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.811418] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.811552] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.811824] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.811979] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.812104] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.812325] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.812589] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.812589] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: f476f6c8-d91f-42a2-b79a-39c5c22a437d is going to be created. [ 654.831932] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.832151] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.832273] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.836028] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.836028] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.836028] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-f476f6c8-d91f-42a2-b79a-39c5c22a437d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.525533] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: SUCCESS [ 655.525822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.526592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.526592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.526592] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.526592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.526592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.527144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.527144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.527144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.527144] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.821363] env[69692]: INFO networking_nsxv3.common.synchronization [req-c02b8522-46ec-4a72-a5c2-19bfdef4e864 req-ac2a1d3f-1c05-4d6a-ac5d-2959b5415a64 service nova] Enqueued Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_rules [ 655.821623] env[69692]: INFO networking_nsxv3.common.synchronization [req-c02b8522-46ec-4a72-a5c2-19bfdef4e864 req-ac2a1d3f-1c05-4d6a-ac5d-2959b5415a64 service nova] Enqueued Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_members [ 655.821672] env[69692]: INFO networking_nsxv3.common.synchronization [req-c02b8522-46ec-4a72-a5c2-19bfdef4e864 req-ac2a1d3f-1c05-4d6a-ac5d-2959b5415a64 service nova] Enqueued Resource ID: f476f6c8-d91f-42a2-b79a-39c5c22a437d with Priority: HIGHEST for action port [ 655.821911] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_rules [ 655.822083] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_members [ 655.823757] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f476f6c8-d91f-42a2-b79a-39c5c22a437d with Priority: HIGHEST for action port [ 655.823757] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.823757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.827898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.827898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.827898] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.827898] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.827898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.827898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.827898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.827898] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.827898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.827898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.827898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.827898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.827898] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.828405] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-f476f6c8-d91f-42a2-b79a-39c5c22a437d taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.828405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f476f6c8-d91f-42a2-b79a-39c5c22a437d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.828405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f476f6c8-d91f-42a2-b79a-39c5c22a437d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.828513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f476f6c8-d91f-42a2-b79a-39c5c22a437d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.829171] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f476f6c8-d91f-42a2-b79a-39c5c22a437d',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.032671] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.032671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.032671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.032671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.032671] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.032671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.032671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.032671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.032671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.032671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.032671] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.032671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.032671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.032671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.032671] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.032671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.033332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.033332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.033332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.033332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.033332] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.187995] env[69692]: INFO networking_nsxv3.common.synchronization [None req-a9c54859-9208-4f5a-ac71-fc36028b752a None None] Enqueued Resource ID: 083e12a3-fe5d-429a-b66e-62d0ce4d87c0 with Priority: HIGHEST for action port [ 656.187995] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 083e12a3-fe5d-429a-b66e-62d0ce4d87c0 with Priority: HIGHEST for action port [ 656.188482] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-083e12a3-fe5d-429a-b66e-62d0ce4d87c0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.189404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-083e12a3-fe5d-429a-b66e-62d0ce4d87c0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.189404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-083e12a3-fe5d-429a-b66e-62d0ce4d87c0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.189404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-083e12a3-fe5d-429a-b66e-62d0ce4d87c0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.189404] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('083e12a3-fe5d-429a-b66e-62d0ce4d87c0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.318276] env[69692]: INFO networking_nsxv3.common.synchronization [None req-feb4aabb-0378-40e6-bd7d-e398a431de6e None None] Enqueued Resource ID: 0b6d80a3-b219-4f21-a5cc-84420dd0ac1a with Priority: HIGHEST for action port [ 656.318940] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6d80a3-b219-4f21-a5cc-84420dd0ac1a with Priority: HIGHEST for action port [ 656.319238] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b6d80a3-b219-4f21-a5cc-84420dd0ac1a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.319403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b6d80a3-b219-4f21-a5cc-84420dd0ac1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.319436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b6d80a3-b219-4f21-a5cc-84420dd0ac1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.319854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b6d80a3-b219-4f21-a5cc-84420dd0ac1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.319854] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b6d80a3-b219-4f21-a5cc-84420dd0ac1a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.335368] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.337041] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.337041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.337204] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f476f6c8-d91f-42a2-b79a-39c5c22a437d with status ACTIVE [ 656.337398] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.337491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.338073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.338073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.338073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.341749] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.341749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.341749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.341749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.341749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.341749] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.341749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.341749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.341749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.341749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.341749] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f476f6c8-d91f-42a2-b79a-39c5c22a437d is going to be updated. [ 656.361838] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.361838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.361838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.361838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.361838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.361838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f476f6c8-d91f-42a2-b79a-39c5c22a437d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.534368] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3f4ecb4-733b-4e4f-a088-b50706c8f083: rpc.has_security_group_logging(os_id): False [ 656.561699] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.561699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.561699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.561699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.561699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.561699] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.561699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.561699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.561699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.561699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.561699] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.561699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.561699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.561699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.561699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.562360] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.562360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.562360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.562360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.562360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.562360] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 is going to be created. [ 656.598912] env[69692]: INFO networking_nsxv3.common.synchronization [req-35f52214-831d-4717-b156-db6c3ac2565d req-cb4b8390-b0e2-4447-a3c5-38d1f3275dd8 tempest-ListImageFiltersTestJSON-1628776345 tempest-ListImageFiltersTestJSON-1628776345-project-member] Enqueued Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_members [ 656.599587] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_members [ 656.600334] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.601525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.601525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.601525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.601525] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.601525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.601525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.601525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.601525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.601841] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.623751] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.623908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.623976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.624221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.624412] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.637638] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: IN_PROGRESS for 2s [ 656.692765] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 083e12a3-fe5d-429a-b66e-62d0ce4d87c0 [ 656.692765] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.692765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.692765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.693158] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.693158] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.693158] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:083e12a3-fe5d-429a-b66e-62d0ce4d87c0 already deleted. [ 656.693158] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-083e12a3-fe5d-429a-b66e-62d0ce4d87c0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.696109] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 in Status: SUCCESS [ 656.696365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.822533] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b6d80a3-b219-4f21-a5cc-84420dd0ac1a [ 656.822533] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.822870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.822870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.822870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.822948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.823096] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b6d80a3-b219-4f21-a5cc-84420dd0ac1a already deleted. [ 656.828763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b6d80a3-b219-4f21-a5cc-84420dd0ac1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.845885] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.106035] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.339379] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.339627] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.339773] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.340073] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.340331] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.340481] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.340594] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.340813] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.341645] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.342090] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.342230] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.343019] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.343019] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.343019] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.343019] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.343019] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.351782] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.355265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.355265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.355265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.355265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.355265] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92949372-ad62-4c3b-ab83-73cb755bd4de is going to be created. [ 657.362291] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.362445] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 657.362591] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.362845] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.365044] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-289d8bd4-3d57-4c25-8fab-6cda2dbb8171 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.365044] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-289d8bd4-3d57-4c25-8fab-6cda2dbb8171" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.365044] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-289d8bd4-3d57-4c25-8fab-6cda2dbb8171" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.365044] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-289d8bd4-3d57-4c25-8fab-6cda2dbb8171" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.365044] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('289d8bd4-3d57-4c25-8fab-6cda2dbb8171',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.377649] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.377649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.377649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.378076] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.378365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.393658] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: UNINITIALIZED for 2s [ 657.608699] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.871646] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.871646] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.871646] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.871981] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.871981] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.872396] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 289d8bd4-3d57-4c25-8fab-6cda2dbb8171 not found, creating... [ 657.872396] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.872539] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.872659] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.872899] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.876024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.876024] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.876024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.876024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.876024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.876024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.876024] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 289d8bd4-3d57-4c25-8fab-6cda2dbb8171 is going to be created. [ 657.897072] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.897303] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.897441] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.897732] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.898051] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.898195] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-289d8bd4-3d57-4c25-8fab-6cda2dbb8171" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.111295] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.111466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.111627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.111766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.111857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.111960] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 is going to be updated. [ 658.147981] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.147981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.147981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.147981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.147981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.157117] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: IN_PROGRESS for 2s [ 658.442613] env[69692]: INFO networking_nsxv3.common.synchronization [None req-322e6c06-93c0-46b6-906c-851215a9db04 None None] Enqueued Resource ID: dd50736c-1d60-4b80-8dae-a89f73af8ed9 with Priority: HIGHEST for action port [ 658.442613] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd50736c-1d60-4b80-8dae-a89f73af8ed9 with Priority: HIGHEST for action port [ 658.442613] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd50736c-1d60-4b80-8dae-a89f73af8ed9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.442613] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd50736c-1d60-4b80-8dae-a89f73af8ed9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.442613] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd50736c-1d60-4b80-8dae-a89f73af8ed9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.445190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd50736c-1d60-4b80-8dae-a89f73af8ed9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.445190] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd50736c-1d60-4b80-8dae-a89f73af8ed9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.649669] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: SUCCESS [ 658.649897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.789201] env[69692]: INFO networking_nsxv3.common.synchronization [req-667c1382-e25f-4c05-9129-dff0b2d8af55 req-83b115b1-ced2-47c0-9050-3b5928a05262 tempest-SecurityGroupRulesNegativeTestJSON-502383448 tempest-SecurityGroupRulesNegativeTestJSON-502383448-project-member] Enqueued Resource ID: bd949d03-660d-4a2f-b79e-965a7fb21ca2 with Priority: HIGHEST for action security_group_rules [ 658.789684] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd949d03-660d-4a2f-b79e-965a7fb21ca2 with Priority: HIGHEST for action security_group_rules [ 658.789943] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd949d03-660d-4a2f-b79e-965a7fb21ca2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.790156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd949d03-660d-4a2f-b79e-965a7fb21ca2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.790156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd949d03-660d-4a2f-b79e-965a7fb21ca2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.790544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd949d03-660d-4a2f-b79e-965a7fb21ca2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.790544] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd949d03-660d-4a2f-b79e-965a7fb21ca2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.828877] env[69692]: INFO networking_nsxv3.common.synchronization [req-35f52214-831d-4717-b156-db6c3ac2565d req-9b6eface-efd2-40aa-aaa9-fc3a82fd333e service nova] Enqueued Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_rules [ 658.829058] env[69692]: INFO networking_nsxv3.common.synchronization [req-35f52214-831d-4717-b156-db6c3ac2565d req-9b6eface-efd2-40aa-aaa9-fc3a82fd333e service nova] Enqueued Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_members [ 658.829192] env[69692]: INFO networking_nsxv3.common.synchronization [req-35f52214-831d-4717-b156-db6c3ac2565d req-9b6eface-efd2-40aa-aaa9-fc3a82fd333e service nova] Enqueued Resource ID: 289d8bd4-3d57-4c25-8fab-6cda2dbb8171 with Priority: HIGHEST for action port [ 658.829413] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_rules [ 658.829537] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_members [ 658.830565] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 289d8bd4-3d57-4c25-8fab-6cda2dbb8171 with Priority: HIGHEST for action port [ 658.830565] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.830565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.830565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.830565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.831054] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.832118] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.832118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.832118] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-289d8bd4-3d57-4c25-8fab-6cda2dbb8171 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.832118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-289d8bd4-3d57-4c25-8fab-6cda2dbb8171" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.832118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-289d8bd4-3d57-4c25-8fab-6cda2dbb8171" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.832290] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-289d8bd4-3d57-4c25-8fab-6cda2dbb8171" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.832363] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('289d8bd4-3d57-4c25-8fab-6cda2dbb8171',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.840062] env[69692]: INFO networking_nsxv3.common.synchronization [None req-9a1dddbb-d8f1-4bdf-861f-fd3cf97fd2f6 None None] Enqueued Resource ID: cd4c9993-3f89-478d-9919-c3aa58dfcb39 with Priority: HIGHEST for action port [ 658.840927] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd4c9993-3f89-478d-9919-c3aa58dfcb39 with Priority: HIGHEST for action port [ 658.842378] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd4c9993-3f89-478d-9919-c3aa58dfcb39 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.842378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd4c9993-3f89-478d-9919-c3aa58dfcb39" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.842378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd4c9993-3f89-478d-9919-c3aa58dfcb39" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.843214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd4c9993-3f89-478d-9919-c3aa58dfcb39" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.843333] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd4c9993-3f89-478d-9919-c3aa58dfcb39',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.945909] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd50736c-1d60-4b80-8dae-a89f73af8ed9 [ 658.946122] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.946122] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.946197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.946837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.947050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.947155] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd50736c-1d60-4b80-8dae-a89f73af8ed9 already deleted. [ 658.947246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd50736c-1d60-4b80-8dae-a89f73af8ed9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.139192] env[69692]: INFO networking_nsxv3.common.synchronization [req-aba778c7-3fa0-4e6b-ad0f-25c165d62dce req-e67e4bbe-7eb3-4f52-98cb-449f1405b355 tempest-ImagesOneServerTestJSON-180740883 tempest-ImagesOneServerTestJSON-180740883-project-member] Enqueued Resource ID: 8762fd5f-5739-422a-86bf-68d91e441823 with Priority: HIGHEST for action security_group_members [ 659.140621] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8762fd5f-5739-422a-86bf-68d91e441823 with Priority: HIGHEST for action security_group_members [ 659.140941] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8762fd5f-5739-422a-86bf-68d91e441823 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.141090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.141161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.141413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.141574] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.141681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.141746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.141900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.141980] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.142080] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8762fd5f-5739-422a-86bf-68d91e441823',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.314910] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.315191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.315245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.315453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.315550] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.315695] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd949d03-660d-4a2f-b79e-965a7fb21ca2 already deleted. [ 659.315746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd949d03-660d-4a2f-b79e-965a7fb21ca2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.333950] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.333950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.335994] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 289d8bd4-3d57-4c25-8fab-6cda2dbb8171 with status ACTIVE [ 659.335994] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.335994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.335994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.335994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.336328] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.336328] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.336427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.336702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.336702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.336761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.336978] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.337060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.337098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.338155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.338155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.338155] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 289d8bd4-3d57-4c25-8fab-6cda2dbb8171 is going to be updated. [ 659.346615] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd4c9993-3f89-478d-9919-c3aa58dfcb39 [ 659.346615] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.346615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.346615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.346615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.346615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.346615] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd4c9993-3f89-478d-9919-c3aa58dfcb39 already deleted. [ 659.346615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd4c9993-3f89-478d-9919-c3aa58dfcb39" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.356276] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.356561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.356645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.356873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.357056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.357214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-289d8bd4-3d57-4c25-8fab-6cda2dbb8171" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.403394] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: SUCCESS [ 659.404036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.404205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.404496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.404711] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.404827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.404890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.405093] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.405177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.405263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.405359] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.649770] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.649770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.650319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.650546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.650648] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.650891] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.651020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.651088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.651252] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.651332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.651420] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8762fd5f-5739-422a-86bf-68d91e441823 already deleted. [ 659.651504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.705380] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-696 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.707261] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-696" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.707261] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-696" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.707261] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-696" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.707261] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.707261] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.707261] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.707261] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.708222] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.708525] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.708681] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.708806] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.708987] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.709204] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.709304] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.709601] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.728813] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.729034] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 659.729213] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.729398] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-696" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.729766] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-1d37d9ab-6189-4199-89ed-f0e33bb28363 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.729945] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-1d37d9ab-6189-4199-89ed-f0e33bb28363" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.730075] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-1d37d9ab-6189-4199-89ed-f0e33bb28363" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.730396] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-1d37d9ab-6189-4199-89ed-f0e33bb28363" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.730522] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d37d9ab-6189-4199-89ed-f0e33bb28363',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.811608] env[69692]: INFO networking_nsxv3.common.synchronization [req-c94a13d8-a263-4d47-808c-6fabb73ed9ba req-70808b22-1693-4cdc-bcd4-388fb455dde4 tempest-SecurityGroupRulesNegativeTestJSON-502383448 tempest-SecurityGroupRulesNegativeTestJSON-502383448-project-member] Enqueued Resource ID: bd949d03-660d-4a2f-b79e-965a7fb21ca2 with Priority: HIGHEST for action security_group_rules [ 659.812081] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd949d03-660d-4a2f-b79e-965a7fb21ca2 with Priority: HIGHEST for action security_group_rules [ 659.812433] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd949d03-660d-4a2f-b79e-965a7fb21ca2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.812522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd949d03-660d-4a2f-b79e-965a7fb21ca2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.812564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd949d03-660d-4a2f-b79e-965a7fb21ca2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.812758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd949d03-660d-4a2f-b79e-965a7fb21ca2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.812836] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd949d03-660d-4a2f-b79e-965a7fb21ca2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.907511] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.907717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.909058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.909058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.909058] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.909058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.909058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.909058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.909058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.909058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.909058] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.909058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.909058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.909459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.909459] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.909459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.909459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.909583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.909583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.909683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.909770] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.168352] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: SUCCESS [ 660.168352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.168352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.168352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.168352] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.168352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.168352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.168352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.168884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.168884] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.233536] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.233536] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.233536] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.233714] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.233854] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.234017] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 1d37d9ab-6189-4199-89ed-f0e33bb28363 not found, creating... [ 660.234467] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.234467] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.234557] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.234745] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.238020] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.238020] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.238020] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.238020] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.238020] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.238020] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.238020] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 1d37d9ab-6189-4199-89ed-f0e33bb28363 is going to be created. [ 660.255327] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.255603] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.255664] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.255934] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.256177] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.256397] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-1d37d9ab-6189-4199-89ed-f0e33bb28363" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.343231] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.343522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.343522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.343672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.343738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.343833] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd949d03-660d-4a2f-b79e-965a7fb21ca2 already deleted. [ 660.343915] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd949d03-660d-4a2f-b79e-965a7fb21ca2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.411631] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92949372-ad62-4c3b-ab83-73cb755bd4de: rpc.has_security_group_logging(os_id): False [ 660.429690] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.429880] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.429943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.430143] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.430240] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.430462] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.430571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.430629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.430797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.430883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.431078] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.431178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.431237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.431389] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.431466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.431665] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.431768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.431824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.432100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.432211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.432401] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92949372-ad62-4c3b-ab83-73cb755bd4de is going to be created. [ 660.486772] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.486935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.487011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.487238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.487420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.501767] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: IN_PROGRESS for 2s [ 660.672387] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.175737] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.494904] env[69692]: INFO networking_nsxv3.common.synchronization [req-aba778c7-3fa0-4e6b-ad0f-25c165d62dce req-4c0375d1-74d6-4293-8942-8eb7c21b85da service nova] Enqueued Resource ID: 8762fd5f-5739-422a-86bf-68d91e441823 with Priority: HIGHEST for action security_group_rules [ 661.494904] env[69692]: INFO networking_nsxv3.common.synchronization [req-aba778c7-3fa0-4e6b-ad0f-25c165d62dce req-4c0375d1-74d6-4293-8942-8eb7c21b85da service nova] Enqueued Resource ID: 8762fd5f-5739-422a-86bf-68d91e441823 with Priority: HIGHEST for action security_group_members [ 661.494904] env[69692]: INFO networking_nsxv3.common.synchronization [req-aba778c7-3fa0-4e6b-ad0f-25c165d62dce req-4c0375d1-74d6-4293-8942-8eb7c21b85da service nova] Enqueued Resource ID: 1d37d9ab-6189-4199-89ed-f0e33bb28363 with Priority: HIGHEST for action port [ 661.494904] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8762fd5f-5739-422a-86bf-68d91e441823 with Priority: HIGHEST for action security_group_rules [ 661.494904] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8762fd5f-5739-422a-86bf-68d91e441823 with Priority: HIGHEST for action security_group_members [ 661.494904] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d37d9ab-6189-4199-89ed-f0e33bb28363 with Priority: HIGHEST for action port [ 661.500962] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8762fd5f-5739-422a-86bf-68d91e441823 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.500962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.500962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.501162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.501162] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8762fd5f-5739-422a-86bf-68d91e441823',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.502668] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8762fd5f-5739-422a-86bf-68d91e441823 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.502668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.502668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.502668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.502668] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.502668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.502668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.503043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.503043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.503043] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8762fd5f-5739-422a-86bf-68d91e441823',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.508753] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d37d9ab-6189-4199-89ed-f0e33bb28363 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.508833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d37d9ab-6189-4199-89ed-f0e33bb28363" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.508877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d37d9ab-6189-4199-89ed-f0e33bb28363" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.512066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d37d9ab-6189-4199-89ed-f0e33bb28363" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.512066] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d37d9ab-6189-4199-89ed-f0e33bb28363',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.678398] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.678552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.678615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.678887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.678939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.679162] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 is going to be updated. [ 661.739544] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.739901] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.740054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.741030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.741289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.760977] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: IN_PROGRESS for 2s [ 662.012398] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8762fd5f-5739-422a-86bf-68d91e441823',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.013456] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8762fd5f-5739-422a-86bf-68d91e441823 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.015211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.015211] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d37d9ab-6189-4199-89ed-f0e33bb28363 with status ACTIVE [ 662.015211] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.015211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.015211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.015211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.015211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.015211] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.015211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.015211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.015211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.015211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.015211] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.015646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.015646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.015646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.015646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.015646] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d37d9ab-6189-4199-89ed-f0e33bb28363 is going to be updated. [ 662.039461] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.039667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.039764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.040051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.040116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.040279] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d37d9ab-6189-4199-89ed-f0e33bb28363" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.502900] env[69692]: INFO networking_nsxv3.common.synchronization [None req-4a0a0013-701e-4135-915f-1e6e1182d490 None None] Enqueued Resource ID: 77332ce1-d825-44b3-9fac-d319e1342756 with Priority: HIGHEST for action port [ 662.504849] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77332ce1-d825-44b3-9fac-d319e1342756 with Priority: HIGHEST for action port [ 662.505408] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-77332ce1-d825-44b3-9fac-d319e1342756 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.505408] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77332ce1-d825-44b3-9fac-d319e1342756" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.505539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77332ce1-d825-44b3-9fac-d319e1342756" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.505702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77332ce1-d825-44b3-9fac-d319e1342756" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.505794] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77332ce1-d825-44b3-9fac-d319e1342756',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.514623] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8762fd5f-5739-422a-86bf-68d91e441823',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.519790] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: SUCCESS [ 662.520065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.012780] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77332ce1-d825-44b3-9fac-d319e1342756 [ 663.013537] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.013537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.013537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.013537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.013537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.013754] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77332ce1-d825-44b3-9fac-d319e1342756 already deleted. [ 663.013754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77332ce1-d825-44b3-9fac-d319e1342756" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.018142] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.019116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.019214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.019452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.019499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.019602] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8762fd5f-5739-422a-86bf-68d91e441823 is going to be created. [ 663.056231] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.057281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.057472] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.057782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.058693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.070153] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8762fd5f-5739-422a-86bf-68d91e441823 in Status: UNINITIALIZED for 2s [ 663.772091] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: SUCCESS [ 663.772341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.778015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.778015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.778015] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.778015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.778015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.778015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.778015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.778015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.778015] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.279881] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.280074] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.280150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.280385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.280551] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.280685] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.280749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.280920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.281019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.281110] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.281286] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.281380] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.281440] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.281596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.281735] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.281827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.281898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.282089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.282185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.282269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.282358] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.785411] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3f4ecb4-733b-4e4f-a088-b50706c8f083: rpc.has_security_group_logging(os_id): False [ 664.806021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.806021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.806021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.806021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.806021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.806021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.806021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.806021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.806021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.806021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.806021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.806021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.806021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.806021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.806021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.807565] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.807893] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.808085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.809511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.810354] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.810354] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 is going to be updated. [ 664.872432] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.873646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.873792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.874030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.874283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.887945] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: IN_PROGRESS for 2s [ 665.020081] env[69692]: INFO networking_nsxv3.common.synchronization [None req-33ddbb2f-269e-428e-a82a-f699e3333c87 None None] Enqueued Resource ID: f5fb1b22-4108-4198-a39f-0bceb100ca45 with Priority: HIGHEST for action port [ 665.020331] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5fb1b22-4108-4198-a39f-0bceb100ca45 with Priority: HIGHEST for action port [ 665.020934] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5fb1b22-4108-4198-a39f-0bceb100ca45 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.021076] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5fb1b22-4108-4198-a39f-0bceb100ca45" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.021144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5fb1b22-4108-4198-a39f-0bceb100ca45" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.021429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5fb1b22-4108-4198-a39f-0bceb100ca45" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.021514] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5fb1b22-4108-4198-a39f-0bceb100ca45',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.080017] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8762fd5f-5739-422a-86bf-68d91e441823 in Status: SUCCESS [ 665.080249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.080412] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.080662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.080870] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.080990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.081089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.081260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.081821] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.081821] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.081821] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8762fd5f-5739-422a-86bf-68d91e441823',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.525600] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5fb1b22-4108-4198-a39f-0bceb100ca45 [ 665.525855] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.525993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.526081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.526292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.526380] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.526472] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5fb1b22-4108-4198-a39f-0bceb100ca45 already deleted. [ 665.526562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5fb1b22-4108-4198-a39f-0bceb100ca45" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.590312] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8762fd5f-5739-422a-86bf-68d91e441823 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.590312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.590312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.590312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.590312] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.590312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.590312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.590312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.590312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.590312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.590312] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8762fd5f-5739-422a-86bf-68d91e441823 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.590312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.590312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.590312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.590312] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.590312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.590932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.590932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.590932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.590932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.590932] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8762fd5f-5739-422a-86bf-68d91e441823',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.091894] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8762fd5f-5739-422a-86bf-68d91e441823: rpc.has_security_group_logging(os_id): False [ 666.109706] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.109867] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.109938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.110175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.110273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.110467] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.110547] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.110619] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.110845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.110845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.111074] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.111178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.111244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.111389] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.111449] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.111635] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.111736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.111785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.111918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.111992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.112092] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8762fd5f-5739-422a-86bf-68d91e441823 is going to be created. [ 666.194164] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.194164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.194164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.194349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.194533] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.212066] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8762fd5f-5739-422a-86bf-68d91e441823 in Status: IN_PROGRESS for 2s [ 666.549970] env[69692]: INFO networking_nsxv3.common.synchronization [req-06b94357-51cf-4ad7-9ffb-c1e80b91426a req-70831986-1dd7-4a0d-a20b-968cb4661c12 tempest-ListServersNegativeTestJSON-1033257655 tempest-ListServersNegativeTestJSON-1033257655-project-member] Enqueued Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 666.551418] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 666.551717] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.551806] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.551845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.552150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.552329] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.552439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.552544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.552671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.552755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.552849] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.902578] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: SUCCESS [ 666.905315] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.056793] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.056793] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.056793] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.056793] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.057024] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.057150] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.057622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.057622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.057847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.057938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.058051] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 already deleted. [ 667.059039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.097583] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-649 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.097863] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-649" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.098350] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-649" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.098710] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-649" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.099115] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.099329] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.099474] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.099788] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.100292] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.100292] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.100410] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.100442] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.100553] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.100665] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.100768] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.100904] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.122081] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.122294] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 667.122452] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.122631] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-649" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.122932] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-a7d6c400-86f7-4064-a982-8d67107961e3 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.123116] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-a7d6c400-86f7-4064-a982-8d67107961e3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.123239] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-a7d6c400-86f7-4064-a982-8d67107961e3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.123582] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-a7d6c400-86f7-4064-a982-8d67107961e3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.123716] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7d6c400-86f7-4064-a982-8d67107961e3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.627994] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.628238] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.628362] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.628648] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.628799] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.628956] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port a7d6c400-86f7-4064-a982-8d67107961e3 not found, creating... [ 667.629523] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.629742] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.629865] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.630105] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.630249] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.630617] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.630850] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.630975] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.631203] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.631333] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.631490] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: a7d6c400-86f7-4064-a982-8d67107961e3 is going to be created. [ 667.651027] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.651255] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.651382] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.651652] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.652666] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.652666] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-a7d6c400-86f7-4064-a982-8d67107961e3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.223756] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8762fd5f-5739-422a-86bf-68d91e441823 in Status: SUCCESS [ 668.224104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.425201] env[69692]: INFO networking_nsxv3.common.synchronization [req-06b94357-51cf-4ad7-9ffb-c1e80b91426a req-fcb253d6-c1d5-4cc4-8abe-228ccff4d03f service nova] Enqueued Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_rules [ 668.425523] env[69692]: INFO networking_nsxv3.common.synchronization [req-06b94357-51cf-4ad7-9ffb-c1e80b91426a req-fcb253d6-c1d5-4cc4-8abe-228ccff4d03f service nova] Enqueued Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 668.429018] env[69692]: INFO networking_nsxv3.common.synchronization [req-06b94357-51cf-4ad7-9ffb-c1e80b91426a req-fcb253d6-c1d5-4cc4-8abe-228ccff4d03f service nova] Enqueued Resource ID: a7d6c400-86f7-4064-a982-8d67107961e3 with Priority: HIGHEST for action port [ 668.429018] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_rules [ 668.429018] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 668.429018] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7d6c400-86f7-4064-a982-8d67107961e3 with Priority: HIGHEST for action port [ 668.429018] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.429018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.429018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.429018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.429018] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.429603] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.429837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.430681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.430681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.433277] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.433700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.433700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.433700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.433700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.435265] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.435265] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7d6c400-86f7-4064-a982-8d67107961e3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.435265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7d6c400-86f7-4064-a982-8d67107961e3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.435265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7d6c400-86f7-4064-a982-8d67107961e3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.435265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7d6c400-86f7-4064-a982-8d67107961e3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.435265] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7d6c400-86f7-4064-a982-8d67107961e3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.936853] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.937038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.937224] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.938703] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7d6c400-86f7-4064-a982-8d67107961e3 with status ACTIVE [ 668.938703] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.938703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.938703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.939018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.939018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.939117] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.939192] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.939264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.939452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.939540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.939767] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.939863] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.939920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.940098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.940160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.940247] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7d6c400-86f7-4064-a982-8d67107961e3 is going to be updated. [ 668.961028] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.961028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.961235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.961273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.961417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.961576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7d6c400-86f7-4064-a982-8d67107961e3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.250563] env[69692]: INFO networking_nsxv3.common.synchronization [req-06b94357-51cf-4ad7-9ffb-c1e80b91426a req-879e587f-c550-45d1-b7a9-64847397803f tempest-ListServersNegativeTestJSON-1033257655 tempest-ListServersNegativeTestJSON-1033257655-project-member] Enqueued Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 669.251124] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 669.251469] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.251573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.442867] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.945268] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.945471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.945511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.945722] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.945815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.945917] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 is going to be created. [ 669.975183] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.975365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.975404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.975594] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.975743] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.986133] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: UNINITIALIZED for 2s [ 670.057990] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-649 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.058224] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-649" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.058480] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-649" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.059362] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-649" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.059806] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.060100] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.060307] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.060696] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.064047] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.064047] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.064047] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.064047] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.064047] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.064047] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.064047] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.064047] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.099867] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.099867] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 670.099867] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.099867] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-649" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.099867] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-7d6ae8fe-d315-4af0-b034-8382588f840a taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.099867] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-7d6ae8fe-d315-4af0-b034-8382588f840a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.099867] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-7d6ae8fe-d315-4af0-b034-8382588f840a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.099867] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-7d6ae8fe-d315-4af0-b034-8382588f840a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.099867] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d6ae8fe-d315-4af0-b034-8382588f840a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.602611] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.602955] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.603168] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.603556] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.603807] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.604007] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 7d6ae8fe-d315-4af0-b034-8382588f840a not found, creating... [ 670.604389] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.604619] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.604827] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.605368] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.605599] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.606026] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.606262] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.606440] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.606750] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.606954] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.607177] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 7d6ae8fe-d315-4af0-b034-8382588f840a is going to be created. [ 670.634018] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.634018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.634018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.634018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.634018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.634018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-7d6ae8fe-d315-4af0-b034-8382588f840a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.380632] env[69692]: INFO networking_nsxv3.common.synchronization [req-06b94357-51cf-4ad7-9ffb-c1e80b91426a req-a61b34f5-fc25-4be2-ab21-2528bc29d7c5 service nova] Enqueued Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_rules [ 671.380872] env[69692]: INFO networking_nsxv3.common.synchronization [req-06b94357-51cf-4ad7-9ffb-c1e80b91426a req-a61b34f5-fc25-4be2-ab21-2528bc29d7c5 service nova] Enqueued Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 671.380970] env[69692]: INFO networking_nsxv3.common.synchronization [req-06b94357-51cf-4ad7-9ffb-c1e80b91426a req-a61b34f5-fc25-4be2-ab21-2528bc29d7c5 service nova] Enqueued Resource ID: 7d6ae8fe-d315-4af0-b034-8382588f840a with Priority: HIGHEST for action port [ 671.381218] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_rules [ 671.381343] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 671.381436] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d6ae8fe-d315-4af0-b034-8382588f840a with Priority: HIGHEST for action port [ 671.383907] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.383907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.383907] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.383907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.383907] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d6ae8fe-d315-4af0-b034-8382588f840a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.383907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d6ae8fe-d315-4af0-b034-8382588f840a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.383907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d6ae8fe-d315-4af0-b034-8382588f840a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.383907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d6ae8fe-d315-4af0-b034-8382588f840a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.383907] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d6ae8fe-d315-4af0-b034-8382588f840a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.886303] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d6ae8fe-d315-4af0-b034-8382588f840a with status ACTIVE [ 671.886610] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.886838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.886921] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.887194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.887312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.887529] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.887666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.887734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.887897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.888687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.888687] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.888687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.888687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.888687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.888687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.888687] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d6ae8fe-d315-4af0-b034-8382588f840a is going to be updated. [ 671.912032] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.912185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.912357] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.913030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.913030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.913030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d6ae8fe-d315-4af0-b034-8382588f840a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.996540] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: SUCCESS [ 671.996764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.996971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.997250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.997490] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.997650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.997731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.997904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.998013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.998112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.998235] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.999244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.999444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.999609] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.999741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.999803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.999972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.000095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.000214] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.502654] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.502654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.502654] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.008526] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.025765] env[69692]: INFO networking_nsxv3.common.synchronization [req-06b94357-51cf-4ad7-9ffb-c1e80b91426a req-4052a7bf-a6fa-45d4-9071-a0b30e4bc143 tempest-ListServersNegativeTestJSON-1033257655 tempest-ListServersNegativeTestJSON-1033257655-project-member] Enqueued Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 673.027298] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 673.027298] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.027470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.466037] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-649 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.467704] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-649" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.467704] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-649" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.468842] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-649" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.469201] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.469389] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.469512] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.469818] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.469990] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.470260] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.470393] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.470515] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.470633] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.470779] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.470938] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.471107] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.494627] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.494829] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 673.494964] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.495182] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-649" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.495524] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-201f4334-c57c-426c-b9d0-48a1b1c37d36 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.495711] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-201f4334-c57c-426c-b9d0-48a1b1c37d36" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.495831] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-201f4334-c57c-426c-b9d0-48a1b1c37d36" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.496214] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-201f4334-c57c-426c-b9d0-48a1b1c37d36" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.496373] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('201f4334-c57c-426c-b9d0-48a1b1c37d36',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.511684] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.513160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.513160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.513160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.513160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.513160] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 is going to be updated. [ 673.539799] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.540086] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.540305] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.540558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.541153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.553303] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: IN_PROGRESS for 2s [ 673.999627] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.000238] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.000399] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.000727] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.000935] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.001109] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 201f4334-c57c-426c-b9d0-48a1b1c37d36 not found, creating... [ 674.001654] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.001873] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.002050] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.002336] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.002504] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.003033] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.003188] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.003332] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.003593] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.003755] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.003918] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 201f4334-c57c-426c-b9d0-48a1b1c37d36 is going to be created. [ 674.024495] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.024800] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.024909] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.025267] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.025542] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.025807] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-201f4334-c57c-426c-b9d0-48a1b1c37d36" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.756984] env[69692]: INFO networking_nsxv3.common.synchronization [req-06b94357-51cf-4ad7-9ffb-c1e80b91426a req-a5ad6976-4418-44bb-9d06-98467cfcc0cd service nova] Enqueued Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_rules [ 674.756984] env[69692]: INFO networking_nsxv3.common.synchronization [req-06b94357-51cf-4ad7-9ffb-c1e80b91426a req-a5ad6976-4418-44bb-9d06-98467cfcc0cd service nova] Enqueued Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 674.756984] env[69692]: INFO networking_nsxv3.common.synchronization [req-06b94357-51cf-4ad7-9ffb-c1e80b91426a req-a5ad6976-4418-44bb-9d06-98467cfcc0cd service nova] Enqueued Resource ID: 201f4334-c57c-426c-b9d0-48a1b1c37d36 with Priority: HIGHEST for action port [ 674.756984] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_rules [ 674.757183] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 674.757252] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201f4334-c57c-426c-b9d0-48a1b1c37d36 with Priority: HIGHEST for action port [ 674.757870] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.757993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.759029] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.759029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.759029] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-201f4334-c57c-426c-b9d0-48a1b1c37d36 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.759029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-201f4334-c57c-426c-b9d0-48a1b1c37d36" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.759029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-201f4334-c57c-426c-b9d0-48a1b1c37d36" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.759320] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-201f4334-c57c-426c-b9d0-48a1b1c37d36" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.759320] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('201f4334-c57c-426c-b9d0-48a1b1c37d36',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.266129] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 201f4334-c57c-426c-b9d0-48a1b1c37d36 with status ACTIVE [ 675.266129] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.266129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.266129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.266129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.266129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.266129] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.266129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.266129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.266129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.266129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.266129] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.266129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.266129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.266129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.266129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.266129] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 201f4334-c57c-426c-b9d0-48a1b1c37d36 is going to be updated. [ 675.292070] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.292070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.292070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.292070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.292070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.292679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-201f4334-c57c-426c-b9d0-48a1b1c37d36" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.563496] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: SUCCESS [ 675.564720] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.564986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.565119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.565329] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.565421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.565484] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.565635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.565710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.565817] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.743593] env[69692]: INFO networking_nsxv3.common.synchronization [None req-83658b03-2e75-41fc-9a18-fb357724a5bb None None] Enqueued Resource ID: 11c77685-674f-491d-a53a-ef42ad216ef3 with Priority: HIGHEST for action port [ 675.743806] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c77685-674f-491d-a53a-ef42ad216ef3 with Priority: HIGHEST for action port [ 675.745500] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-11c77685-674f-491d-a53a-ef42ad216ef3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.745500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11c77685-674f-491d-a53a-ef42ad216ef3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.745500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11c77685-674f-491d-a53a-ef42ad216ef3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.745500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11c77685-674f-491d-a53a-ef42ad216ef3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.745500] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11c77685-674f-491d-a53a-ef42ad216ef3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.000524] env[69692]: INFO networking_nsxv3.common.synchronization [req-a3790e90-0110-44f8-9458-d41c174a8884 req-3a9c9dec-9db0-43ed-97e4-7e8e8e9edb91 tempest-FloatingIPsAssociationTestJSON-220159259 tempest-FloatingIPsAssociationTestJSON-220159259-project-member] Enqueued Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_members [ 676.001771] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_members [ 676.002325] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.002473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.002549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.002752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.002912] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.003018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.003083] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.003235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.003319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.003412] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.070132] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.248915] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11c77685-674f-491d-a53a-ef42ad216ef3 [ 676.249304] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.249458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.249558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.249926] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.250032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.250210] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11c77685-674f-491d-a53a-ef42ad216ef3 already deleted. [ 676.250326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11c77685-674f-491d-a53a-ef42ad216ef3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.506619] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.574970] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.011750] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.013520] env[69692]: INFO networking_nsxv3.common.synchronization [req-504c3507-555a-4db0-b68c-145e090957b0 req-099830eb-b674-47bc-8cf7-d6107e03ea78 tempest-ServersTestJSON-1710059859 tempest-ServersTestJSON-1710059859-project-member] Enqueued Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGHEST for action security_group_members [ 677.014899] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGHEST for action security_group_members [ 677.015460] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d9ea5c0-4781-4575-9fde-6a93632303e0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.015920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.016147] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.016515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.016865] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.017132] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.017332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.017711] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.017923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.018483] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d9ea5c0-4781-4575-9fde-6a93632303e0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.077125] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.077282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.077351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.077573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.077740] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.077868] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 is going to be updated. [ 677.143361] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.143506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.143585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.143847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.143926] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.154250] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: IN_PROGRESS for 2s [ 677.156767] env[69692]: INFO networking_nsxv3.common.synchronization [None req-27133055-d278-43ac-b391-55f06adc95d9 tempest-ServersTestFqdnHostnames-1208998322 tempest-ServersTestFqdnHostnames-1208998322-project-member] Enqueued Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGHEST for action security_group_rules [ 677.157320] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGHEST for action security_group_rules [ 677.157661] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8df4df4-eeff-413c-833f-3852b9a4a49a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.157956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.160310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.160310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.160310] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.177636] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-393 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.178132] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-393" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.178316] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-393" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.178650] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-393" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.178971] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.179217] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.179499] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.179796] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.179985] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.180325] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.180490] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.180642] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.180804] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.180968] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.181096] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.181227] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.200691] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.200899] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 677.201074] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.201314] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-393" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.201746] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.201980] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.202163] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.204071] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.204728] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.286830] env[69692]: INFO networking_nsxv3.common.synchronization [None req-0e1a615f-3c49-41e4-b526-d77b43df3226 tempest-ServersTestFqdnHostnames-1208998322 tempest-ServersTestFqdnHostnames-1208998322-project-member] Enqueued Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGHEST for action security_group_rules [ 677.289382] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGHEST for action security_group_rules [ 677.289764] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8df4df4-eeff-413c-833f-3852b9a4a49a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.289887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.515981] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.516263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.519393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.519393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.519393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.519393] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 is going to be updated. [ 677.523892] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.526755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.526755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.526755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.526755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.526755] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.526755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.526755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.526755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.526755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.526755] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 is going to be updated. [ 677.551934] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.551934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.551934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.551934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.551934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.554065] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.554241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.554299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.554443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.554573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.567130] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 in Status: IN_PROGRESS for 2s [ 677.567743] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: IN_PROGRESS for 2s [ 677.682222] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.682384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.682467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.683066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.683066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.683066] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8df4df4-eeff-413c-833f-3852b9a4a49a already deleted. [ 677.683066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.683286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.683286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.683360] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.708541] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.708541] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.708698] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.708841] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.708989] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.709158] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc not found, creating... [ 677.709413] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.709573] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.709695] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.709978] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.710129] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.710408] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.710559] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.710674] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.710918] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.711067] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.711204] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc is going to be created. [ 677.729997] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.730215] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.730290] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.730767] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.730767] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.730965] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.215065] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.215257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.215325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.215542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.215625] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.215726] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8df4df4-eeff-413c-833f-3852b9a4a49a already deleted. [ 678.215809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.359620] env[69692]: INFO networking_nsxv3.common.synchronization [None req-ace88a67-32c7-4cd3-a173-66fc8b12e7cb None None] Enqueued Resource ID: b00dc816-9167-4ea7-8cb0-1eedafcbfe75 with Priority: HIGHEST for action port [ 678.359932] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b00dc816-9167-4ea7-8cb0-1eedafcbfe75 with Priority: HIGHEST for action port [ 678.360600] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-b00dc816-9167-4ea7-8cb0-1eedafcbfe75 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.360693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b00dc816-9167-4ea7-8cb0-1eedafcbfe75" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.360753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b00dc816-9167-4ea7-8cb0-1eedafcbfe75" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.361025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b00dc816-9167-4ea7-8cb0-1eedafcbfe75" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.362016] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b00dc816-9167-4ea7-8cb0-1eedafcbfe75',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.518649] env[69692]: INFO networking_nsxv3.common.synchronization [req-a3790e90-0110-44f8-9458-d41c174a8884 req-94e18833-6da3-49cd-b0ec-9f02e7f22e3f service nova] Enqueued Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_rules [ 678.518934] env[69692]: INFO networking_nsxv3.common.synchronization [req-a3790e90-0110-44f8-9458-d41c174a8884 req-94e18833-6da3-49cd-b0ec-9f02e7f22e3f service nova] Enqueued Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_members [ 678.518934] env[69692]: INFO networking_nsxv3.common.synchronization [req-a3790e90-0110-44f8-9458-d41c174a8884 req-94e18833-6da3-49cd-b0ec-9f02e7f22e3f service nova] Enqueued Resource ID: e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc with Priority: HIGHEST for action port [ 678.519197] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_rules [ 678.519479] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_members [ 678.519479] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc with Priority: HIGHEST for action port [ 678.520964] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.521155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.521217] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.521441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.521524] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.522571] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.522677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.522885] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.522986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.523089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.523475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.523475] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.864402] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b00dc816-9167-4ea7-8cb0-1eedafcbfe75 [ 678.864402] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.864402] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.864402] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.864402] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.864402] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.864402] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b00dc816-9167-4ea7-8cb0-1eedafcbfe75 already deleted. [ 678.864402] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b00dc816-9167-4ea7-8cb0-1eedafcbfe75" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.026327] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.026452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.026668] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc with status ACTIVE [ 679.026832] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.026940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.027036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.027274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.027360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.027534] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.027630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.027688] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.027845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.027924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.028122] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.028216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.028277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.028417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.028490] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.028573] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc is going to be updated. [ 679.048519] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.048712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.048992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.049142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.049238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.049506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9eb2af9-0ab9-4a2d-84c5-98b8ea236cfc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.167000] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: SUCCESS [ 679.167000] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.167000] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.167000] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.167000] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.167000] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.167000] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.167420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.167420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.167420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.167592] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.167592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.167592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.167748] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.167881] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.167970] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.168051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.168197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.168271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.168502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.168502] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.169310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.169485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.169645] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.169747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.169820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.170040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.170094] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.170134] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.578094] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: SUCCESS [ 679.578450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.578487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.579355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.579355] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.579355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.579355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.579355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.579355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.579635] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.582980] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 in Status: SUCCESS [ 679.583298] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 deletion is rescheduled due to dependency. [ 679.583488] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.671597] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5345cc2-0f25-4dd2-bed5-a938bfc6e247: rpc.has_security_group_logging(os_id): False [ 679.674272] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.694206] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.694206] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.694206] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.694206] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.694206] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.694497] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.694497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.694497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.694614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.696661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.696661] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.696661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.696661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.696661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.696661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.696661] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.696661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.696661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.696661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.696661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.696661] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 is going to be created. [ 679.762138] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.762138] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.762138] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.762138] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.762138] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.771877] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: IN_PROGRESS for 2s [ 680.085377] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.175740] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.587366] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.680026] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.680215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.680296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.681039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.681039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.681039] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 is going to be updated. [ 680.709813] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.709964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.710076] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.710263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.710422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.719528] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: IN_PROGRESS for 2s [ 681.090046] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.090046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.090396] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.090396] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.090504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.090554] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 is going to be updated. [ 681.117816] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.118027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.118027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.118271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.118409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.127402] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: IN_PROGRESS for 2s [ 681.783409] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: SUCCESS [ 681.783757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.783757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.783952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.784054] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.286931] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.287219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.729115] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: SUCCESS [ 682.729353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.729520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.729763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.730068] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.730230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.730298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.730475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.730559] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.730655] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.138077] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: IN_PROGRESS for 4s [ 683.232403] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.520213] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 683.520325] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 683.737115] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.239590] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.240025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.240025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.240135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.240234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.240335] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 is going to be updated. [ 684.266320] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.266509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.266564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.266781] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.266944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.276588] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: IN_PROGRESS for 2s [ 685.150300] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: SUCCESS [ 685.150471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.150552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.150834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.151180] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.151180] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.151180] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.151394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.151476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.151565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.152438] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.654685] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.655019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.655154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.656728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.656728] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.656728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.656728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.656728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.656728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.656728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.656728] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.656728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.656728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.657135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.657220] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.657297] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.657385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.657576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.657685] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.657798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.657907] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.161036] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 559d2715-9b43-4a1c-ab57-3faf644a7a85: rpc.has_security_group_logging(os_id): False [ 686.182249] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.182418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.182481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.182710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.182835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.183064] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.183179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.183247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.183474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.183474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.183685] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.183779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.184189] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.184189] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.184189] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.184342] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.184406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.184437] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.184599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.184678] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.184765] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 is going to be updated. [ 686.259087] env[69692]: INFO networking_nsxv3.common.synchronization [req-aa2b2fce-467e-4e50-a074-19d4ba7b0a0d req-13ff07c6-7f09-4a29-9992-e0018dbe74f6 tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGHEST for action security_group_members [ 686.259633] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGHEST for action security_group_members [ 686.260064] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-501c3651-4f53-4420-b2dc-d80ff25930b1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.260191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.260400] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.260787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.261011] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.261118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.261180] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.261368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.261551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.261551] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.263485] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.263485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.263485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.263680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.263841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.284045] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: IN_PROGRESS for 2s [ 686.290381] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: SUCCESS [ 686.290611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.290922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.291984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.291984] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.291984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.291984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.291984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.296170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.296170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.296170] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.766613] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.766939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.766981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.767372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.767533] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.767867] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.768047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.768154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.774142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.774142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.774142] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 already deleted. [ 686.774142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.797222] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.797381] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.797438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.797673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.797827] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.797942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.798034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.798201] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.798285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.798370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.798520] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.798614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.798669] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.799010] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.799212] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.799355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.799423] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.799598] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.799686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.799770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.799983] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.303969] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5345cc2-0f25-4dd2-bed5-a938bfc6e247: rpc.has_security_group_logging(os_id): False [ 687.321857] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.321857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.321857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.321857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.321857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.322378] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.322378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.322378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.322496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.322496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.322669] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.322762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.322829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.322964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.323106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.323246] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.323337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.323407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.324241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.324366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.324459] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 is going to be updated. [ 687.374168] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.374168] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.374336] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.374813] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.375242] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.376194] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.376462] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.376798] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.377042] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.377365] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.377533] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.377706] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.377895] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.378700] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.379211] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.379573] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.384981] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.385129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.385204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.385423] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.385547] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.399471] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: IN_PROGRESS for 2s [ 687.408560] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.408560] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 687.408560] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.408560] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.408560] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-394d95fe-4743-43c4-b13b-65bd8e257abb taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.408560] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-394d95fe-4743-43c4-b13b-65bd8e257abb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.408560] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-394d95fe-4743-43c4-b13b-65bd8e257abb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.408560] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-394d95fe-4743-43c4-b13b-65bd8e257abb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.409337] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('394d95fe-4743-43c4-b13b-65bd8e257abb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.912639] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.912936] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.913386] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.913721] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.914018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.914236] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 394d95fe-4743-43c4-b13b-65bd8e257abb not found, creating... [ 687.914561] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.914792] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.914959] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.915461] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.915813] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.916194] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.916420] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.916586] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.916850] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.917198] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.917901] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 394d95fe-4743-43c4-b13b-65bd8e257abb is going to be created. [ 687.937814] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.941350] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.941500] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.941797] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.942046] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.942317] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-394d95fe-4743-43c4-b13b-65bd8e257abb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.084443] env[69692]: INFO networking_nsxv3.common.synchronization [req-0d36be66-5c86-4861-b350-225e1b87487d req-09e2fa2a-64f2-46bb-b4af-b2b3889bc500 tempest-ListServersNegativeTestJSON-1033257655 tempest-ListServersNegativeTestJSON-1033257655-project-member] Enqueued Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 688.085218] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 688.085377] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.085499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.085751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.086234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.086606] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.086872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.087774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.087774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.087774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.087774] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.299721] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: SUCCESS [ 688.299993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.412940] env[69692]: INFO networking_nsxv3.common.synchronization [None req-d15d4529-9501-4621-9474-d41612da4da3 None None] Enqueued Resource ID: c550a48d-3f80-4eac-8f33-3e5f9d236dd5 with Priority: HIGHEST for action port [ 688.412940] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c550a48d-3f80-4eac-8f33-3e5f9d236dd5 with Priority: HIGHEST for action port [ 688.412940] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-c550a48d-3f80-4eac-8f33-3e5f9d236dd5 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.412940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c550a48d-3f80-4eac-8f33-3e5f9d236dd5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.412940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c550a48d-3f80-4eac-8f33-3e5f9d236dd5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.412940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c550a48d-3f80-4eac-8f33-3e5f9d236dd5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.412940] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c550a48d-3f80-4eac-8f33-3e5f9d236dd5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.590319] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.919167] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c550a48d-3f80-4eac-8f33-3e5f9d236dd5 [ 688.919167] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.920341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.920341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.920341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.920341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.920341] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c550a48d-3f80-4eac-8f33-3e5f9d236dd5 already deleted. [ 688.920341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c550a48d-3f80-4eac-8f33-3e5f9d236dd5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.921756] env[69692]: INFO networking_nsxv3.common.synchronization [req-aa2b2fce-467e-4e50-a074-19d4ba7b0a0d req-8bfc93c0-87e4-441d-bb32-ed5d235a3d76 service nova] Enqueued Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGHEST for action security_group_rules [ 688.921756] env[69692]: INFO networking_nsxv3.common.synchronization [req-aa2b2fce-467e-4e50-a074-19d4ba7b0a0d req-8bfc93c0-87e4-441d-bb32-ed5d235a3d76 service nova] Enqueued Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGHEST for action security_group_members [ 688.921756] env[69692]: INFO networking_nsxv3.common.synchronization [req-aa2b2fce-467e-4e50-a074-19d4ba7b0a0d req-8bfc93c0-87e4-441d-bb32-ed5d235a3d76 service nova] Enqueued Resource ID: 394d95fe-4743-43c4-b13b-65bd8e257abb with Priority: HIGHEST for action port [ 688.925119] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGHEST for action security_group_rules [ 688.925290] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGHEST for action security_group_members [ 688.925398] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394d95fe-4743-43c4-b13b-65bd8e257abb with Priority: HIGHEST for action port [ 688.927130] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-501c3651-4f53-4420-b2dc-d80ff25930b1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.927265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.927369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.927552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.927643] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.928614] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-501c3651-4f53-4420-b2dc-d80ff25930b1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.928717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.928794] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.929013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.929183] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.929295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.929365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.929517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.929603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.929692] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.931856] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-394d95fe-4743-43c4-b13b-65bd8e257abb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.933070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-394d95fe-4743-43c4-b13b-65bd8e257abb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.933247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-394d95fe-4743-43c4-b13b-65bd8e257abb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.933537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-394d95fe-4743-43c4-b13b-65bd8e257abb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.934600] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('394d95fe-4743-43c4-b13b-65bd8e257abb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.094146] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.413994] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: SUCCESS [ 689.414250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.414508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.414730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.414819] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.437526] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.440308] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-501c3651-4f53-4420-b2dc-d80ff25930b1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.440415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.440950] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 394d95fe-4743-43c4-b13b-65bd8e257abb with status ACTIVE [ 689.440950] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.441095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.441095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.441308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.441495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.442191] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.442191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.442191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.442191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.442376] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.442905] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.442905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.442905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.442905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.442905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.442905] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 394d95fe-4743-43c4-b13b-65bd8e257abb is going to be updated. [ 689.463357] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.463561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.463642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.463860] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.464016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.464226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-394d95fe-4743-43c4-b13b-65bd8e257abb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.603662] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.603662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.603662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.603662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.603662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.603662] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 is going to be updated. [ 689.633626] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.633749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.633782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.634033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.634222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.643255] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: IN_PROGRESS for 2s [ 689.922372] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.922686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.941053] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.283026] env[69692]: INFO networking_nsxv3.common.synchronization [None req-4e0422ea-b4f5-4629-8cc0-a0e9d432eb89 tempest-ServersTestBootFromVolume-1974867416 tempest-ServersTestBootFromVolume-1974867416-project-member] Enqueued Resource ID: 7ae9a71f-5c96-43e4-8524-e661508c021c with Priority: HIGHEST for action security_group_rules [ 690.283026] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ae9a71f-5c96-43e4-8524-e661508c021c with Priority: HIGHEST for action security_group_rules [ 690.283496] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ae9a71f-5c96-43e4-8524-e661508c021c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.283974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.284197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.284599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.284819] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ae9a71f-5c96-43e4-8524-e661508c021c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.418309] env[69692]: INFO networking_nsxv3.common.synchronization [None req-869fa94e-4d05-4116-bc91-e5a76c4dc1a8 tempest-ServersTestBootFromVolume-1974867416 tempest-ServersTestBootFromVolume-1974867416-project-member] Enqueued Resource ID: 7ae9a71f-5c96-43e4-8524-e661508c021c with Priority: HIGHEST for action security_group_rules [ 690.418793] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ae9a71f-5c96-43e4-8524-e661508c021c with Priority: HIGHEST for action security_group_rules [ 690.419110] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ae9a71f-5c96-43e4-8524-e661508c021c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.419253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.449567] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.449746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.449820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.450123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.450220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.450319] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 is going to be created. [ 690.472595] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.472756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.472827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.473136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.473287] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.483157] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 in Status: UNINITIALIZED for 2s [ 690.486396] env[69692]: INFO networking_nsxv3.common.synchronization [None req-728bd0de-8a94-40da-b523-31d7634724fc None None] Enqueued Resource ID: c1bc6daa-753a-43bb-91fe-d21ebfac7260 with Priority: HIGHEST for action port [ 690.486997] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1bc6daa-753a-43bb-91fe-d21ebfac7260 with Priority: HIGHEST for action port [ 690.487243] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1bc6daa-753a-43bb-91fe-d21ebfac7260 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.487385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1bc6daa-753a-43bb-91fe-d21ebfac7260" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.487494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1bc6daa-753a-43bb-91fe-d21ebfac7260" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.487693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1bc6daa-753a-43bb-91fe-d21ebfac7260" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.487896] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1bc6daa-753a-43bb-91fe-d21ebfac7260',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.807889] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.808128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.808321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.808418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.808576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.808757] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ae9a71f-5c96-43e4-8524-e661508c021c already deleted. [ 690.808757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.808965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.809075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.809144] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ae9a71f-5c96-43e4-8524-e661508c021c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.993682] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1bc6daa-753a-43bb-91fe-d21ebfac7260 [ 690.993910] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.994053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.994234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.994336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.994434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.994528] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1bc6daa-753a-43bb-91fe-d21ebfac7260 already deleted. [ 690.994608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1bc6daa-753a-43bb-91fe-d21ebfac7260" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.240955] env[69692]: INFO networking_nsxv3.common.synchronization [None req-2d4196e5-e817-4ecf-812c-1fc78fa4209c None None] Enqueued Resource ID: d4e1cd49-c183-4ab8-9bce-30ffac8810a4 with Priority: HIGHEST for action port [ 691.240955] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4e1cd49-c183-4ab8-9bce-30ffac8810a4 with Priority: HIGHEST for action port [ 691.240955] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4e1cd49-c183-4ab8-9bce-30ffac8810a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.240955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4e1cd49-c183-4ab8-9bce-30ffac8810a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.240955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4e1cd49-c183-4ab8-9bce-30ffac8810a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.240955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4e1cd49-c183-4ab8-9bce-30ffac8810a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.240955] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4e1cd49-c183-4ab8-9bce-30ffac8810a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.333534] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.333702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.333774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.333995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.334773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.334773] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ae9a71f-5c96-43e4-8524-e661508c021c already deleted. [ 691.334773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.653581] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: SUCCESS [ 691.653746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.653921] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.654176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.654359] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.654477] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.654544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.654700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.654785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.654869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.654957] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.743705] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4e1cd49-c183-4ab8-9bce-30ffac8810a4 [ 691.743896] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.744082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.744156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.744447] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.744485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.744555] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4e1cd49-c183-4ab8-9bce-30ffac8810a4 already deleted. [ 691.744635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4e1cd49-c183-4ab8-9bce-30ffac8810a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.160050] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.160050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.160050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.160050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.160469] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.160469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.160469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.160469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.160621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.160621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.160744] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.160875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.160929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.161093] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.161240] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.161333] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.161394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.161534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.161902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.161902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.161902] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.482119] env[69692]: INFO networking_nsxv3.common.synchronization [None req-8e7e4751-f25c-4791-b4b1-cbfbcc0813a2 None None] Enqueued Resource ID: 0a243149-4553-4094-b6e3-75d1628793a8 with Priority: HIGHEST for action port [ 692.483417] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a243149-4553-4094-b6e3-75d1628793a8 with Priority: HIGHEST for action port [ 692.484892] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a243149-4553-4094-b6e3-75d1628793a8 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.485059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a243149-4553-4094-b6e3-75d1628793a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.485173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a243149-4553-4094-b6e3-75d1628793a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.485449] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a243149-4553-4094-b6e3-75d1628793a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.485527] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a243149-4553-4094-b6e3-75d1628793a8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.495663] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 in Status: SUCCESS [ 692.495861] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.496223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.496223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.496631] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.496631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.496631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.496792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.496792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.496881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.496973] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.665719] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5345cc2-0f25-4dd2-bed5-a938bfc6e247: rpc.has_security_group_logging(os_id): False [ 692.683729] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.684091] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.684091] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.684269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.684269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.685782] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.685782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.685782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.685782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.685782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.685782] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.685782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.685782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.685782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.685782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.685782] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.685782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.688682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.688893] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.688986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.689092] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 is going to be updated. [ 692.746597] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.746732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.746806] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.747045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.747168] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.758878] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: IN_PROGRESS for 2s [ 692.989670] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a243149-4553-4094-b6e3-75d1628793a8 [ 692.989670] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.989670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.989670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.989670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.989670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.989670] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a243149-4553-4094-b6e3-75d1628793a8 already deleted. [ 692.989670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a243149-4553-4094-b6e3-75d1628793a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.000053] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.506765] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 501c3651-4f53-4420-b2dc-d80ff25930b1: rpc.has_security_group_logging(os_id): False [ 693.523507] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.523686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.523760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.523993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.524110] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.524404] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.524510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.524574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.524753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.524845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.524935] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 is going to be created. [ 693.579139] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.579326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.579410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.579626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.579861] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.590825] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 in Status: IN_PROGRESS for 2s [ 694.771705] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: SUCCESS [ 694.771946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.543220] env[69692]: INFO networking_nsxv3.common.synchronization [req-98f083e3-4a2c-4bc3-adec-7e1c5f5f64b3 req-4f184f1c-3050-46cf-92d1-0007a4ba00c6 tempest-ServerDiagnosticsNegativeTest-813179295 tempest-ServerDiagnosticsNegativeTest-813179295-project-member] Enqueued Resource ID: a8524b03-3553-4474-98ff-53fee924a364 with Priority: HIGHEST for action security_group_members [ 695.543752] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8524b03-3553-4474-98ff-53fee924a364 with Priority: HIGHEST for action security_group_members [ 695.544073] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8524b03-3553-4474-98ff-53fee924a364 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.544202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.544272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.544566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.544728] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.544831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.544894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.545234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.545464] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.545464] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8524b03-3553-4474-98ff-53fee924a364',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.604269] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 in Status: SUCCESS [ 695.604503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.050566] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.050988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.050988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.050988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.051179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.051250] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.051352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.051451] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.051574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.051650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.051734] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8524b03-3553-4474-98ff-53fee924a364 already deleted. [ 696.051816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.069365] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.069611] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.070548] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.074197] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.074567] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.076035] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.076035] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.076035] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.076035] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.076035] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.076035] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.076035] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.076035] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.076035] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.076035] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.076463] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.101340] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.105020] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.105020] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.105020] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.105020] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-b531f93b-ae6c-4714-8e31-863d04c2f5de taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.105020] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-b531f93b-ae6c-4714-8e31-863d04c2f5de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.105020] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-b531f93b-ae6c-4714-8e31-863d04c2f5de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.105020] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-b531f93b-ae6c-4714-8e31-863d04c2f5de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.105020] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b531f93b-ae6c-4714-8e31-863d04c2f5de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.605911] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.606217] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.606350] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.606635] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.606770] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.606927] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port b531f93b-ae6c-4714-8e31-863d04c2f5de not found, creating... [ 696.607208] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.607370] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.607486] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.607703] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.607840] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.608165] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.608376] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.608449] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.608699] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.608841] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.608995] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: b531f93b-ae6c-4714-8e31-863d04c2f5de is going to be created. [ 696.632688] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.632946] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.633089] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.633448] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.633727] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.634035] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-b531f93b-ae6c-4714-8e31-863d04c2f5de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.409654] env[69692]: INFO networking_nsxv3.common.synchronization [req-2b9a7e81-3a7f-44e3-94d1-f277b64ca82a req-87292ecf-3a19-4005-ba77-95b079d9b381 tempest-FloatingIPsAssociationTestJSON-220159259 tempest-FloatingIPsAssociationTestJSON-220159259-project-member] Enqueued Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_members [ 697.411853] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_members [ 697.412235] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.416027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.416027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.416027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.416027] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.416027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.416027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.416027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.416027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.416027] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.551850] env[69692]: INFO networking_nsxv3.common.synchronization [req-98f083e3-4a2c-4bc3-adec-7e1c5f5f64b3 req-0a515137-70ba-4ba9-8d9b-1f39a67cce5d service nova] Enqueued Resource ID: a8524b03-3553-4474-98ff-53fee924a364 with Priority: HIGHEST for action security_group_rules [ 697.551850] env[69692]: INFO networking_nsxv3.common.synchronization [req-98f083e3-4a2c-4bc3-adec-7e1c5f5f64b3 req-0a515137-70ba-4ba9-8d9b-1f39a67cce5d service nova] Enqueued Resource ID: a8524b03-3553-4474-98ff-53fee924a364 with Priority: HIGHEST for action security_group_members [ 697.551850] env[69692]: INFO networking_nsxv3.common.synchronization [req-98f083e3-4a2c-4bc3-adec-7e1c5f5f64b3 req-0a515137-70ba-4ba9-8d9b-1f39a67cce5d service nova] Enqueued Resource ID: b531f93b-ae6c-4714-8e31-863d04c2f5de with Priority: HIGHEST for action port [ 697.551850] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8524b03-3553-4474-98ff-53fee924a364 with Priority: HIGHEST for action security_group_rules [ 697.551850] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8524b03-3553-4474-98ff-53fee924a364 with Priority: HIGHEST for action security_group_members [ 697.551850] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b531f93b-ae6c-4714-8e31-863d04c2f5de with Priority: HIGHEST for action port [ 697.554692] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8524b03-3553-4474-98ff-53fee924a364 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.554692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.554692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.555250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.555250] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8524b03-3553-4474-98ff-53fee924a364',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.556053] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8524b03-3553-4474-98ff-53fee924a364 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.556196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.556274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.556488] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.556962] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.556962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.556962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.556962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.557176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.557208] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8524b03-3553-4474-98ff-53fee924a364',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.561394] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-b531f93b-ae6c-4714-8e31-863d04c2f5de taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.561530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b531f93b-ae6c-4714-8e31-863d04c2f5de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.561601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b531f93b-ae6c-4714-8e31-863d04c2f5de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.562036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b531f93b-ae6c-4714-8e31-863d04c2f5de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.562036] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b531f93b-ae6c-4714-8e31-863d04c2f5de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.915911] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.062212] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a8524b03-3553-4474-98ff-53fee924a364',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.066279] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8524b03-3553-4474-98ff-53fee924a364 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.066279] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.066483] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b531f93b-ae6c-4714-8e31-863d04c2f5de with status ACTIVE [ 698.066638] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.071359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.071515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.071839] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.072019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.072219] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.074089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.074089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.074089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.074089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.074089] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.074089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.074089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.074089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.074089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.074089] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b531f93b-ae6c-4714-8e31-863d04c2f5de is going to be updated. [ 698.096750] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.097548] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.097666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.098031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.098203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.098375] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b531f93b-ae6c-4714-8e31-863d04c2f5de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.417981] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.576016] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a8524b03-3553-4474-98ff-53fee924a364',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.920645] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.920854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.920854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.923012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.923012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.923012] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 is going to be updated. [ 698.952981] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.953221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.953221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.953444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.953587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.962512] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: IN_PROGRESS for 2s [ 699.079062] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.079237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.079312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.079515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.079605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.079702] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8524b03-3553-4474-98ff-53fee924a364 is going to be created. [ 699.107730] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.108139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.108139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.108359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.108424] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.118443] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8524b03-3553-4474-98ff-53fee924a364 in Status: UNINITIALIZED for 2s [ 700.929402] env[69692]: INFO networking_nsxv3.common.synchronization [req-6695e69f-1c24-4fed-ba62-6d6db0cf1cf1 req-7e0cc985-8fed-467f-a256-91b6db662efc tempest-ServerDiskConfigTestJSON-756528476 tempest-ServerDiskConfigTestJSON-756528476-project-member] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 700.929900] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 700.930295] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.930419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.930483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.930743] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.930890] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.930995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.931080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.931250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.931332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.931430] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.972929] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: SUCCESS [ 700.973170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.133054] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8524b03-3553-4474-98ff-53fee924a364 in Status: SUCCESS [ 701.133287] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.133465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.133711] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.133867] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.133991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.134066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.134229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.134308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.134393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.134480] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8524b03-3553-4474-98ff-53fee924a364',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.371464] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.371673] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.371795] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.372151] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.372418] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.372570] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.372930] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.372930] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.373074] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.373326] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.373387] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.373470] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.373576] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.373683] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.373788] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.373916] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.393887] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.394040] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 701.394462] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.394462] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.395348] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-9525e76c-4118-4693-b96f-6dfd171d665b taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.395348] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-9525e76c-4118-4693-b96f-6dfd171d665b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.395501] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-9525e76c-4118-4693-b96f-6dfd171d665b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.395877] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-9525e76c-4118-4693-b96f-6dfd171d665b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.396292] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9525e76c-4118-4693-b96f-6dfd171d665b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.434670] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.434784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.434784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.435037] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.435586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.435586] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.435586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.435586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.435935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.435935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.435935] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 already deleted. [ 701.435935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.640157] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8524b03-3553-4474-98ff-53fee924a364 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.640416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.640537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.640805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.641101] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.641227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.641299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.641486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.641561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.641671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.641884] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8524b03-3553-4474-98ff-53fee924a364 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.642020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.642222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.642268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.642423] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.642548] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.642594] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.643128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.643128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.643128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.643128] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8524b03-3553-4474-98ff-53fee924a364',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.901778] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.902042] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.902181] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.902529] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.902691] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.902852] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 9525e76c-4118-4693-b96f-6dfd171d665b not found, creating... [ 701.903147] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.903311] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.903431] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.903670] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.903813] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.904133] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.904295] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.904415] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.904633] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.904769] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.904910] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 9525e76c-4118-4693-b96f-6dfd171d665b is going to be created. [ 701.928295] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.928524] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.928655] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.928969] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.929252] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.929502] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-9525e76c-4118-4693-b96f-6dfd171d665b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.145587] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8524b03-3553-4474-98ff-53fee924a364: rpc.has_security_group_logging(os_id): False [ 702.170604] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.170761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.170840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.171057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.171150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.171368] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.171472] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.171534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.171673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.171744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.172071] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.172071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.172071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.172219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.173011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.173011] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.173011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.173011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.173011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.173011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.173011] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8524b03-3553-4474-98ff-53fee924a364 is going to be created. [ 702.252267] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.252267] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.252267] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.252625] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.252825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.269143] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8524b03-3553-4474-98ff-53fee924a364 in Status: IN_PROGRESS for 2s [ 702.716967] env[69692]: INFO networking_nsxv3.common.synchronization [req-6695e69f-1c24-4fed-ba62-6d6db0cf1cf1 req-43cf7856-a423-42e8-8152-bb60f4116c95 service nova] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_rules [ 702.716967] env[69692]: INFO networking_nsxv3.common.synchronization [req-6695e69f-1c24-4fed-ba62-6d6db0cf1cf1 req-43cf7856-a423-42e8-8152-bb60f4116c95 service nova] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 702.716967] env[69692]: INFO networking_nsxv3.common.synchronization [req-6695e69f-1c24-4fed-ba62-6d6db0cf1cf1 req-43cf7856-a423-42e8-8152-bb60f4116c95 service nova] Enqueued Resource ID: 9525e76c-4118-4693-b96f-6dfd171d665b with Priority: HIGHEST for action port [ 702.716967] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_rules [ 702.716967] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 702.716967] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9525e76c-4118-4693-b96f-6dfd171d665b with Priority: HIGHEST for action port [ 702.717999] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.718303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.718501] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.718876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.718949] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.719962] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.720202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.720681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.721047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.723342] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.723342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.723342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.723342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.723342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.723342] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.723342] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-9525e76c-4118-4693-b96f-6dfd171d665b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.723342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9525e76c-4118-4693-b96f-6dfd171d665b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.723342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9525e76c-4118-4693-b96f-6dfd171d665b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.723342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9525e76c-4118-4693-b96f-6dfd171d665b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.723342] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9525e76c-4118-4693-b96f-6dfd171d665b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.224451] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.225881] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.226017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.226627] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9525e76c-4118-4693-b96f-6dfd171d665b with status ACTIVE [ 703.226855] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.226991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.227080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.227343] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.227498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.227751] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.227886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.227997] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.228205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.228361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.228601] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.228670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.228725] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.228904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.229012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.229106] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9525e76c-4118-4693-b96f-6dfd171d665b is going to be updated. [ 703.250686] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.250884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.250884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.251197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.251252] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.251421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9525e76c-4118-4693-b96f-6dfd171d665b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.486798] env[69692]: INFO networking_nsxv3.common.synchronization [req-81f9a74d-4029-4847-b426-ec4c11dee472 req-93add755-d7c9-46f0-a84e-8de1c16461c8 tempest-ImagesNegativeTestJSON-1537386860 tempest-ImagesNegativeTestJSON-1537386860-project-member] Enqueued Resource ID: ba349899-fefa-463c-b088-f091f368c717 with Priority: HIGHEST for action security_group_members [ 703.487203] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba349899-fefa-463c-b088-f091f368c717 with Priority: HIGHEST for action security_group_members [ 703.487557] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba349899-fefa-463c-b088-f091f368c717 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.487721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.487815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.489109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.489109] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.489109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.489395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.489395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.489395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.489552] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba349899-fefa-463c-b088-f091f368c717',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.727642] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.938596] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-147 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.938596] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-147" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.938780] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-147" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.939054] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-147" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.939320] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.942288] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.942424] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.942678] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.942825] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.943043] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.943160] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.943292] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.943410] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.943525] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.943630] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.943763] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.960641] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.960855] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 703.961035] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.961263] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-147" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.961623] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-746edea0-1e95-47f0-b7b1-449812812dea taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.961829] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-746edea0-1e95-47f0-b7b1-449812812dea" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.961968] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-746edea0-1e95-47f0-b7b1-449812812dea" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.962336] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-746edea0-1e95-47f0-b7b1-449812812dea" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.962504] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('746edea0-1e95-47f0-b7b1-449812812dea',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.995128] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.995128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.995128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.995128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.995128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.995128] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.995128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.995128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.995128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.995128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.995128] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba349899-fefa-463c-b088-f091f368c717 already deleted. [ 703.995128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.229891] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.230301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.230301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.230370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.230552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.230700] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be created. [ 704.276274] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.276532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.276532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.276731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.276889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.287609] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8524b03-3553-4474-98ff-53fee924a364 in Status: SUCCESS [ 704.287841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.288707] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: UNINITIALIZED for 2s [ 704.469149] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.469149] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.469149] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.470303] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.470303] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.470303] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 746edea0-1e95-47f0-b7b1-449812812dea not found, creating... [ 704.470303] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.470303] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.470303] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.470560] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.470705] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.470922] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.471148] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.471885] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.471885] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.471885] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.471885] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 746edea0-1e95-47f0-b7b1-449812812dea is going to be created. [ 704.494254] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.494475] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.494611] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.494881] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.495143] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.495377] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-746edea0-1e95-47f0-b7b1-449812812dea" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.301660] env[69692]: INFO networking_nsxv3.common.synchronization [req-81f9a74d-4029-4847-b426-ec4c11dee472 req-8e475c48-0384-4423-82b5-63a0a9eb8dc3 service nova] Enqueued Resource ID: ba349899-fefa-463c-b088-f091f368c717 with Priority: HIGHEST for action security_group_rules [ 705.301660] env[69692]: INFO networking_nsxv3.common.synchronization [req-81f9a74d-4029-4847-b426-ec4c11dee472 req-8e475c48-0384-4423-82b5-63a0a9eb8dc3 service nova] Enqueued Resource ID: ba349899-fefa-463c-b088-f091f368c717 with Priority: HIGHEST for action security_group_members [ 705.301660] env[69692]: INFO networking_nsxv3.common.synchronization [req-81f9a74d-4029-4847-b426-ec4c11dee472 req-8e475c48-0384-4423-82b5-63a0a9eb8dc3 service nova] Enqueued Resource ID: 746edea0-1e95-47f0-b7b1-449812812dea with Priority: HIGHEST for action port [ 705.301660] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba349899-fefa-463c-b088-f091f368c717 with Priority: HIGHEST for action security_group_rules [ 705.301660] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba349899-fefa-463c-b088-f091f368c717 with Priority: HIGHEST for action security_group_members [ 705.301660] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746edea0-1e95-47f0-b7b1-449812812dea with Priority: HIGHEST for action port [ 705.301660] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba349899-fefa-463c-b088-f091f368c717 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.301660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.301660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.301660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.301660] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba349899-fefa-463c-b088-f091f368c717',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.301660] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba349899-fefa-463c-b088-f091f368c717 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.301660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.301660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.301660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.302615] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.302615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.302615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.305195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.305300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.305403] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba349899-fefa-463c-b088-f091f368c717',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.306784] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-746edea0-1e95-47f0-b7b1-449812812dea taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.306890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-746edea0-1e95-47f0-b7b1-449812812dea" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.307073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-746edea0-1e95-47f0-b7b1-449812812dea" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.307804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-746edea0-1e95-47f0-b7b1-449812812dea" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.308059] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('746edea0-1e95-47f0-b7b1-449812812dea',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.809749] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba349899-fefa-463c-b088-f091f368c717 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.809886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.810201] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba349899-fefa-463c-b088-f091f368c717',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.811483] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 746edea0-1e95-47f0-b7b1-449812812dea with status ACTIVE [ 705.811483] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.811483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.811661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.811824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.811928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.812223] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.812370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.812443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.812619] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.812835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.812888] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.813377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.813377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.813377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.813377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.813620] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 746edea0-1e95-47f0-b7b1-449812812dea is going to be updated. [ 705.834225] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.834225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.834225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.834225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.834225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.834225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-746edea0-1e95-47f0-b7b1-449812812dea" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.176295] env[69692]: INFO networking_nsxv3.common.synchronization [req-8daa9392-56f8-4a58-91c9-244a0447b511 req-884b8e4c-fb5e-4590-918e-2fe6a0fa3d05 tempest-AttachInterfacesUnderV243Test-2039607704 tempest-AttachInterfacesUnderV243Test-2039607704-project-member] Enqueued Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 706.176760] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 706.177131] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.177303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.177303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.181029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.181479] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.181996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.181996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.182334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.182483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.182647] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.298344] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 706.298592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.298808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.299068] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.299295] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.299457] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.299544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.299729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.299838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.299947] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.300123] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.316539] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba349899-fefa-463c-b088-f091f368c717',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.685849] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.685849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.685849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.686077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.686077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.686167] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.686259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.686316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.686474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.686556] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.686640] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 already deleted. [ 706.686720] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.803442] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.803610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.803682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.803894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.804074] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.804175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.804243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.804397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.804744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.804744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.804744] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.804923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.804923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.805013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.805110] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.805200] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.805259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.805395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.805469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.805551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.805640] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.824310] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.824474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.824533] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.824746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.824845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.825678] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba349899-fefa-463c-b088-f091f368c717 is going to be created. [ 706.849593] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.849751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.849812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.850071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.850252] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.861698] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba349899-fefa-463c-b088-f091f368c717 in Status: UNINITIALIZED for 2s [ 707.005050] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-503 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.005277] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.005373] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.006081] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.006081] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.006285] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.007042] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.007042] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.007042] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.007042] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 707.007274] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.007380] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.007426] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.007555] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 707.007626] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.007744] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.033631] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.033793] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 707.033981] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.034219] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.034635] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-d698553d-76ff-49bb-949a-c56b81bc55ca taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.034865] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.035052] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.035468] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.035633] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d698553d-76ff-49bb-949a-c56b81bc55ca',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.310849] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcbeb6f9-c515-4ff5-9c1f-1b944526d767: rpc.has_security_group_logging(os_id): False [ 707.332991] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.333488] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.333488] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.333488] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.333620] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.333763] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.333890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.333944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.334146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.334273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.334663] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.334728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.334796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.334996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.335100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.335342] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.335468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.335518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.335665] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.335755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.335850] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be created. [ 707.401293] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.401524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.401593] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.401850] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.402066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.416857] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 707.543391] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.543391] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.543391] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.543391] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.543391] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.543391] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port d698553d-76ff-49bb-949a-c56b81bc55ca not found, creating... [ 707.543391] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.543391] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.543391] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.543391] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.543391] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.544139] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.544503] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.544756] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.545131] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.545373] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.545609] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: d698553d-76ff-49bb-949a-c56b81bc55ca is going to be created. [ 707.565730] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.566150] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.566415] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.566800] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.567305] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.567633] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.568344] env[69692]: INFO networking_nsxv3.common.synchronization [req-8daa9392-56f8-4a58-91c9-244a0447b511 req-53fdc83d-ef73-451c-b0e7-cdce9f3d1589 service nova] Enqueued Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_rules [ 708.568600] env[69692]: INFO networking_nsxv3.common.synchronization [req-8daa9392-56f8-4a58-91c9-244a0447b511 req-53fdc83d-ef73-451c-b0e7-cdce9f3d1589 service nova] Enqueued Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 708.568785] env[69692]: INFO networking_nsxv3.common.synchronization [req-8daa9392-56f8-4a58-91c9-244a0447b511 req-53fdc83d-ef73-451c-b0e7-cdce9f3d1589 service nova] Enqueued Resource ID: d698553d-76ff-49bb-949a-c56b81bc55ca with Priority: HIGHEST for action port [ 708.569283] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_rules [ 708.569429] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 708.569799] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d698553d-76ff-49bb-949a-c56b81bc55ca with Priority: HIGHEST for action port [ 708.569799] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.569960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.570295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.570589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.572924] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.572924] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.572924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.572924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.572924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.572924] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.572924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.572924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.572924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.572924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.572924] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.577423] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-d698553d-76ff-49bb-949a-c56b81bc55ca taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.578086] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.578197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.578436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.578675] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d698553d-76ff-49bb-949a-c56b81bc55ca',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.872829] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba349899-fefa-463c-b088-f091f368c717 in Status: SUCCESS [ 708.873103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.873273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.873564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.873693] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.873927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.873927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.874176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.874267] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.874320] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.874408] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba349899-fefa-463c-b088-f091f368c717',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.081276] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.081434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.081628] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.088247] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d698553d-76ff-49bb-949a-c56b81bc55ca with status ACTIVE [ 709.088247] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.088247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.088247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.088247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.088247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.088247] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.088247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.088247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.088247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.088247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.088247] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.088247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.088247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.088247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.088247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.088247] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d698553d-76ff-49bb-949a-c56b81bc55ca is going to be updated. [ 709.112057] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.112810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.112929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.113382] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.113647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.113882] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.378322] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba349899-fefa-463c-b088-f091f368c717 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.378554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.378650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.378819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.379104] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.379104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.379295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.379345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.379440] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.379726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.379726] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba349899-fefa-463c-b088-f091f368c717 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.379877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.379877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.379994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.380222] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.380327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.380378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.380533] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.380610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.380694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.380787] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba349899-fefa-463c-b088-f091f368c717',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.428590] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 709.428868] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.589242] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.884575] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba349899-fefa-463c-b088-f091f368c717: rpc.has_security_group_logging(os_id): False [ 709.904257] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.904490] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.904595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.904920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.905052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.905259] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.905350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.905418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.905595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.905712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.905965] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.906083] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.906144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.906295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.906365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.906633] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.906878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.906878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.906993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.907071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.907158] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba349899-fefa-463c-b088-f091f368c717 is going to be created. [ 709.975232] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.975306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.975352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.975595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.975762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.986711] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba349899-fefa-463c-b088-f091f368c717 in Status: IN_PROGRESS for 2s [ 710.095546] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.095711] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.099022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.099022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.099022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.099022] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 is going to be created. [ 710.124871] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.125137] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.125216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.125429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.125583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.135473] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: UNINITIALIZED for 2s [ 711.288766] env[69692]: INFO networking_nsxv3.common.synchronization [req-0c2db7c7-9a0a-43fd-b586-c3968d02df6b req-ee625544-b634-44b1-ab71-af08ab1fa428 tempest-DeleteServersAdminTestJSON-1110711245 tempest-DeleteServersAdminTestJSON-1110711245-project-member] Enqueued Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_members [ 711.289389] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_members [ 711.289679] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.289819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.289964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.290479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.291104] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.291632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.291632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.291632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.291834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.291955] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.342310] env[69692]: INFO networking_nsxv3.common.synchronization [req-57f909a6-236b-4260-b0a2-db604d234525 req-275c7c04-fa19-45c2-85cf-3d0ab0c78715 tempest-ServerDiagnosticsNegativeTest-813179295 tempest-ServerDiagnosticsNegativeTest-813179295-project-member] Enqueued Resource ID: a8524b03-3553-4474-98ff-53fee924a364 with Priority: HIGHEST for action security_group_members [ 711.343396] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8524b03-3553-4474-98ff-53fee924a364 with Priority: HIGHEST for action security_group_members [ 711.343881] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8524b03-3553-4474-98ff-53fee924a364 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.344090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.344090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.344371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.344593] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.344756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.344756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.344925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.345098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.345152] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8524b03-3553-4474-98ff-53fee924a364',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.725353] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.725353] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.725353] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.725353] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.725549] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.725694] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.725805] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.726327] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.726531] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.726742] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 711.728211] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.728211] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.728211] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.728211] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 711.728211] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.728211] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.746953] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.746953] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 711.746953] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.746953] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.746953] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-00bd5aa4-c3e7-447c-a7da-acb5646380f7 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.746953] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-00bd5aa4-c3e7-447c-a7da-acb5646380f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.746953] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-00bd5aa4-c3e7-447c-a7da-acb5646380f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.747719] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-00bd5aa4-c3e7-447c-a7da-acb5646380f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.747719] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00bd5aa4-c3e7-447c-a7da-acb5646380f7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.799155] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.799523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.799523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.799809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.799951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.801213] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.801213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.801213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.801496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.801681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.801807] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb is going to be updated. [ 711.827055] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.827640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.828244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.828244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.828244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.838275] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: IN_PROGRESS for 2s [ 711.849627] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.849627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.849627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.849627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.849627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.849627] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.849627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.849627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.849627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.849627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.849627] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8524b03-3553-4474-98ff-53fee924a364 is going to be updated. [ 711.882633] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.882633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.882633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.882633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.882633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.890493] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8524b03-3553-4474-98ff-53fee924a364 in Status: IN_PROGRESS for 2s [ 711.999813] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba349899-fefa-463c-b088-f091f368c717 in Status: SUCCESS [ 712.000185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.145139] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: UNINITIALIZED for 4s [ 712.226800] env[69692]: INFO networking_nsxv3.common.synchronization [req-935ba60f-d1ef-4a57-a276-fea24baa8b4b req-f4d447db-90d8-448b-b910-4ac119531d52 tempest-VolumesAssistedSnapshotsTest-1274009765 tempest-VolumesAssistedSnapshotsTest-1274009765-project-member] Enqueued Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGHEST for action security_group_members [ 712.227395] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGHEST for action security_group_members [ 712.227769] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d4ca52d-d178-4c04-a293-073162c8fb0b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.227898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.228018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.228549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.228714] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.228822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.228907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.229113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.229276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.229384] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d4ca52d-d178-4c04-a293-073162c8fb0b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.253552] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.253899] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.254133] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.254572] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.254795] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.255103] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 00bd5aa4-c3e7-447c-a7da-acb5646380f7 not found, creating... [ 712.255627] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.255759] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.255913] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.257888] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.258126] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.258528] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.258704] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.258825] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.259624] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.259624] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.259624] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 00bd5aa4-c3e7-447c-a7da-acb5646380f7 is going to be created. [ 712.292872] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.293222] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.293402] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.294548] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.294548] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.294548] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-00bd5aa4-c3e7-447c-a7da-acb5646380f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.736573] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.736908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.736908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.737165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.737387] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.737387] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.737534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.737534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.737660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.737740] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.737830] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b is going to be updated. [ 712.767587] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.767749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.767822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.767998] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.768145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.776536] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b in Status: IN_PROGRESS for 2s [ 713.101691] env[69692]: INFO networking_nsxv3.common.synchronization [req-0c2db7c7-9a0a-43fd-b586-c3968d02df6b req-34fd1f2f-b68e-4036-ad8d-78a62fe4a7d5 service nova] Enqueued Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_rules [ 713.101879] env[69692]: INFO networking_nsxv3.common.synchronization [req-0c2db7c7-9a0a-43fd-b586-c3968d02df6b req-34fd1f2f-b68e-4036-ad8d-78a62fe4a7d5 service nova] Enqueued Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_members [ 713.102041] env[69692]: INFO networking_nsxv3.common.synchronization [req-0c2db7c7-9a0a-43fd-b586-c3968d02df6b req-34fd1f2f-b68e-4036-ad8d-78a62fe4a7d5 service nova] Enqueued Resource ID: 00bd5aa4-c3e7-447c-a7da-acb5646380f7 with Priority: HIGHEST for action port [ 713.105022] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_rules [ 713.105022] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_members [ 713.105022] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00bd5aa4-c3e7-447c-a7da-acb5646380f7 with Priority: HIGHEST for action port [ 713.105022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.105022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.105022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.105022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.105022] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.105022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.105022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.105022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-00bd5aa4-c3e7-447c-a7da-acb5646380f7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.105022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00bd5aa4-c3e7-447c-a7da-acb5646380f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.105022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00bd5aa4-c3e7-447c-a7da-acb5646380f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.105599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00bd5aa4-c3e7-447c-a7da-acb5646380f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.105599] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00bd5aa4-c3e7-447c-a7da-acb5646380f7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.606912] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.607267] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.607267] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00bd5aa4-c3e7-447c-a7da-acb5646380f7 with status ACTIVE [ 713.607510] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.607596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.607596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.607822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.607911] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.608110] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.608236] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.608282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.608437] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.608516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.608826] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.608826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.608922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.608981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.609105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.609191] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00bd5aa4-c3e7-447c-a7da-acb5646380f7 is going to be updated. [ 713.633420] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.633651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.633651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.633854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.633994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.634218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00bd5aa4-c3e7-447c-a7da-acb5646380f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.851022] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: SUCCESS [ 713.851022] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb deletion is rescheduled due to dependency. [ 713.851022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.851022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.851022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.851022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.851022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.851022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.851630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.851630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.851630] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.903069] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8524b03-3553-4474-98ff-53fee924a364 in Status: SUCCESS [ 713.903069] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8524b03-3553-4474-98ff-53fee924a364 deletion is rescheduled due to dependency. [ 713.903069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8524b03-3553-4474-98ff-53fee924a364" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.142124] env[69692]: INFO networking_nsxv3.common.synchronization [None req-51b196ac-e40d-4df1-a1d9-0f6018e939d3 None None] Enqueued Resource ID: b5231a6e-0a21-4ec7-aca4-bfd37e6328e2 with Priority: HIGHEST for action port [ 714.142452] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5231a6e-0a21-4ec7-aca4-bfd37e6328e2 with Priority: HIGHEST for action port [ 714.142738] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5231a6e-0a21-4ec7-aca4-bfd37e6328e2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.142859] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5231a6e-0a21-4ec7-aca4-bfd37e6328e2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.142925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5231a6e-0a21-4ec7-aca4-bfd37e6328e2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.143445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5231a6e-0a21-4ec7-aca4-bfd37e6328e2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.143553] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5231a6e-0a21-4ec7-aca4-bfd37e6328e2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.155648] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: SUCCESS [ 714.155870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.156056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.156290] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.156487] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.156633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.156676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.156823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.156904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.156990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.157092] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.354869] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.646434] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5231a6e-0a21-4ec7-aca4-bfd37e6328e2 [ 714.646434] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.646434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.646434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.646769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.646769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.646769] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5231a6e-0a21-4ec7-aca4-bfd37e6328e2 already deleted. [ 714.646905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5231a6e-0a21-4ec7-aca4-bfd37e6328e2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.660370] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.785863] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b in Status: SUCCESS [ 714.786111] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b deletion is rescheduled due to dependency. [ 714.786317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.861449] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.162054] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66714054-d28c-49d2-8bed-8ed704c74fc1: rpc.has_security_group_logging(os_id): False [ 715.184873] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.184873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.184873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.184873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.184873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.185077] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.185143] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.185235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.185360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.185434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.185523] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 is going to be created. [ 715.247809] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.247957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.248062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.248293] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.248489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.265163] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: IN_PROGRESS for 2s [ 715.288391] env[69692]: INFO networking_nsxv3.common.synchronization [None req-29efa224-6fd3-4d23-826b-35407a2ba180 tempest-ServerActionsTestOtherB-2042336296 tempest-ServerActionsTestOtherB-2042336296-project-member] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_rules [ 715.289098] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_rules [ 715.289431] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.289639] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.289758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.290040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.290171] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.334320] env[69692]: INFO networking_nsxv3.common.synchronization [None req-86392a99-9c1c-4717-8cba-6aab7a323134 tempest-MigrationsAdminTest-1006177328 tempest-MigrationsAdminTest-1006177328-project-member] Enqueued Resource ID: 5191a234-0397-4f95-b2e6-84394f992584 with Priority: HIGHEST for action security_group_rules [ 715.334320] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5191a234-0397-4f95-b2e6-84394f992584 with Priority: HIGHEST for action security_group_rules [ 715.335790] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5191a234-0397-4f95-b2e6-84394f992584 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.336289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5191a234-0397-4f95-b2e6-84394f992584" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.337276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5191a234-0397-4f95-b2e6-84394f992584" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.339522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5191a234-0397-4f95-b2e6-84394f992584" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.339522] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5191a234-0397-4f95-b2e6-84394f992584',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.367368] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.367368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.367368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.367368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.367368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.367368] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb is going to be updated. [ 715.412142] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.412142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.412142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.412142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.412142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.421229] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: IN_PROGRESS for 2s [ 715.488185] env[69692]: INFO networking_nsxv3.common.synchronization [None req-cceb99eb-8fef-47d1-8a48-f56503a36719 tempest-ServerActionsTestOtherB-2042336296 tempest-ServerActionsTestOtherB-2042336296-project-member] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_rules [ 715.488185] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_rules [ 715.488185] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.488185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.574266] env[69692]: INFO networking_nsxv3.common.synchronization [None req-df00a00a-f963-4140-b83e-f3a00cd394af tempest-MigrationsAdminTest-1006177328 tempest-MigrationsAdminTest-1006177328-project-member] Enqueued Resource ID: 5191a234-0397-4f95-b2e6-84394f992584 with Priority: HIGHEST for action security_group_rules [ 715.574807] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5191a234-0397-4f95-b2e6-84394f992584 with Priority: HIGHEST for action security_group_rules [ 715.575115] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5191a234-0397-4f95-b2e6-84394f992584 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.575224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5191a234-0397-4f95-b2e6-84394f992584" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.810536] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.810536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.810536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.810536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.810536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.810536] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 already deleted. [ 715.810536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.810536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.811055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.811055] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.861901] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.861901] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.861901] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.862163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.862283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.862973] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5191a234-0397-4f95-b2e6-84394f992584 already deleted. [ 715.863135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5191a234-0397-4f95-b2e6-84394f992584" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.863324] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5191a234-0397-4f95-b2e6-84394f992584" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.863729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5191a234-0397-4f95-b2e6-84394f992584" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.863829] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5191a234-0397-4f95-b2e6-84394f992584',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.336113] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.336113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.337532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.337532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.337532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.337532] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 already deleted. [ 716.337532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.386982] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.387232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.387317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.387513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.387701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.387803] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5191a234-0397-4f95-b2e6-84394f992584 already deleted. [ 716.387876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5191a234-0397-4f95-b2e6-84394f992584" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.449740] env[69692]: INFO networking_nsxv3.common.synchronization [None req-29a572f6-7976-4b90-8179-ecb3b0c9cc6d None None] Enqueued Resource ID: 0b6e9eaa-ba7c-4fc8-ad5d-884f2130f8f2 with Priority: HIGHEST for action port [ 716.450362] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6e9eaa-ba7c-4fc8-ad5d-884f2130f8f2 with Priority: HIGHEST for action port [ 716.451052] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b6e9eaa-ba7c-4fc8-ad5d-884f2130f8f2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.451052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b6e9eaa-ba7c-4fc8-ad5d-884f2130f8f2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.451052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b6e9eaa-ba7c-4fc8-ad5d-884f2130f8f2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.451292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b6e9eaa-ba7c-4fc8-ad5d-884f2130f8f2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.451292] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b6e9eaa-ba7c-4fc8-ad5d-884f2130f8f2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.704386] env[69692]: INFO networking_nsxv3.common.synchronization [req-56c1b3ba-995e-4a43-b680-30098bb65049 req-86f6170d-69c4-46bb-8ff9-eae40368998f tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 716.708253] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 716.709802] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.711260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.711260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.711260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.711500] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.711651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.711732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.711914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.712048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.712178] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.784773] env[69692]: INFO networking_nsxv3.common.synchronization [req-5091930e-8af8-4d9c-a0a3-983fee656c76 req-a962d6ef-5958-40d2-a27c-064999cf4dbc tempest-ImagesOneServerTestJSON-180740883 tempest-ImagesOneServerTestJSON-180740883-project-member] Enqueued Resource ID: 8762fd5f-5739-422a-86bf-68d91e441823 with Priority: HIGHEST for action security_group_members [ 716.785347] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8762fd5f-5739-422a-86bf-68d91e441823 with Priority: HIGHEST for action security_group_members [ 716.785654] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8762fd5f-5739-422a-86bf-68d91e441823 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.785771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.785832] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.786066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.786220] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.786314] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.786373] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.786530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.786608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.786711] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8762fd5f-5739-422a-86bf-68d91e441823',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.956015] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b6e9eaa-ba7c-4fc8-ad5d-884f2130f8f2 [ 716.956015] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.956015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.956015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.956015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.956015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.956015] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b6e9eaa-ba7c-4fc8-ad5d-884f2130f8f2 already deleted. [ 716.956015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b6e9eaa-ba7c-4fc8-ad5d-884f2130f8f2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.159517] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.159713] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-207" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.159842] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-207" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.160278] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-207" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.160553] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.160716] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.160870] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.161371] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.161901] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.161901] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.161996] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.162053] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.162224] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.162280] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.162367] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.162505] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.197704] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.197983] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.198091] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.198381] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-207" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.198673] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-f6d48607-3bbc-441a-9949-a453eca068c1 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.198899] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.199069] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.199460] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.199660] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6d48607-3bbc-441a-9949-a453eca068c1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.217669] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.217854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.217928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.218234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.218294] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.218587] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.218702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.218702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.219299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.219299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.219299] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 already deleted. [ 717.219299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.279281] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: SUCCESS [ 717.279281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.291210] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.291210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.291210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.291210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.291210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.291210] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.291210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.291210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.291717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.291717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.291717] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8762fd5f-5739-422a-86bf-68d91e441823 is going to be updated. [ 717.319182] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.319400] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.319476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.319702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.319854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.336837] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8762fd5f-5739-422a-86bf-68d91e441823 in Status: IN_PROGRESS for 2s [ 717.434042] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: SUCCESS [ 717.434401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.434651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.434996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.435667] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.435667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.435667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.436325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.436325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.436651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.436865] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.705022] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.705022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.705022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.705022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.705022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.705022] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port f6d48607-3bbc-441a-9949-a453eca068c1 not found, creating... [ 717.705022] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.705022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.705022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.705022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.705022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.705548] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.705548] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.705548] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.705548] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.705548] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.705548] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: f6d48607-3bbc-441a-9949-a453eca068c1 is going to be created. [ 717.727339] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.727339] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.727339] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.727339] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.727339] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.727339] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.880048] env[69692]: INFO networking_nsxv3.common.synchronization [req-98c5a9c3-2e07-40d8-8832-2d14aaf2d594 req-9407b9af-caec-44e0-8a4a-42b0c554df9b tempest-ImagesNegativeTestJSON-1537386860 tempest-ImagesNegativeTestJSON-1537386860-project-member] Enqueued Resource ID: ba349899-fefa-463c-b088-f091f368c717 with Priority: HIGHEST for action security_group_members [ 717.880048] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba349899-fefa-463c-b088-f091f368c717 with Priority: HIGHEST for action security_group_members [ 717.880360] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba349899-fefa-463c-b088-f091f368c717 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.880632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.880823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.881174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.882573] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.882573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.882573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.882573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.882573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.882573] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba349899-fefa-463c-b088-f091f368c717',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.941232] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.941232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.941232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.941232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.941232] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.941232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.941232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.941650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.941650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.941650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.941835] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.941835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.941978] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.941978] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.942145] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.942237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.942296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.942495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.942578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.942617] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.942695] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.386889] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.386889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.386889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.386889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.386889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.386889] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.386889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.386889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.386889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.386889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.386889] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba349899-fefa-463c-b088-f091f368c717 is going to be updated. [ 718.423310] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.423310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.423310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.423310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.423544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.433108] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba349899-fefa-463c-b088-f091f368c717 in Status: IN_PROGRESS for 2s [ 718.448796] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb: rpc.has_security_group_logging(os_id): False [ 718.462548] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.462783] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.462835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.463084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.463179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.463380] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.463562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.463659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.463792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.463870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.464119] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.464606] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.464714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.464895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.465006] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.465242] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.465367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.465472] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.465604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.465681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.465806] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb is going to be updated. [ 718.535017] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.535399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.535399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.535523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.535583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.546584] env[69692]: INFO networking_nsxv3.common.synchronization [req-56c1b3ba-995e-4a43-b680-30098bb65049 req-8b9d8912-a75e-4f36-a35f-d4d47ae5e3f9 service nova] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_rules [ 718.546796] env[69692]: INFO networking_nsxv3.common.synchronization [req-56c1b3ba-995e-4a43-b680-30098bb65049 req-8b9d8912-a75e-4f36-a35f-d4d47ae5e3f9 service nova] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 718.547012] env[69692]: INFO networking_nsxv3.common.synchronization [req-56c1b3ba-995e-4a43-b680-30098bb65049 req-8b9d8912-a75e-4f36-a35f-d4d47ae5e3f9 service nova] Enqueued Resource ID: f6d48607-3bbc-441a-9949-a453eca068c1 with Priority: HIGHEST for action port [ 718.548367] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: IN_PROGRESS for 2s [ 718.548681] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_rules [ 718.548837] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 718.548935] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d48607-3bbc-441a-9949-a453eca068c1 with Priority: HIGHEST for action port [ 718.549533] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.549667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.549797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.550053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.550219] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.551294] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.551480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.551480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.551673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.551825] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.551954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.551954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.552309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.552309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.552309] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.553144] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6d48607-3bbc-441a-9949-a453eca068c1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.553244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.553326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.554009] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.554150] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6d48607-3bbc-441a-9949-a453eca068c1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.123111] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.123111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.123111] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6d48607-3bbc-441a-9949-a453eca068c1 with status ACTIVE [ 719.123111] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.123111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.123111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.123111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.123111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.123111] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.123111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.123111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.123111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.123111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.123111] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.123731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.123731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.123731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.123731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.123731] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6d48607-3bbc-441a-9949-a453eca068c1 is going to be updated. [ 719.124054] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.143403] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.143611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.143676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.143839] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.143972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.144140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.345743] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8762fd5f-5739-422a-86bf-68d91e441823 in Status: SUCCESS [ 719.345743] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8762fd5f-5739-422a-86bf-68d91e441823 deletion is rescheduled due to dependency. [ 719.345877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.550019] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d24741b-a34a-41e0-b7ce-9703ce5194f1 req-dbcd4005-28f1-44e8-8427-0b2ba107fc4f tempest-ServersAdminTestJSON-1982348900 tempest-ServersAdminTestJSON-1982348900-project-member] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 719.550019] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 719.550019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.550019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.550019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.550019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.550019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.550019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.550019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.550019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.550019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.550019] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.627287] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.054085] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.054215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.054269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.054530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.054627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.054861] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.055068] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.055259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.055304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.055362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.055505] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc already deleted. [ 720.055591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.131175] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.131175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.131175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.131175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.131175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.131175] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be created. [ 720.133666] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.133907] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.134050] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.134372] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.134648] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.134798] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.134906] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.135165] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.135305] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.135523] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.135618] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.135749] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.139021] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.139021] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.139021] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.139021] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.157024] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.157254] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 720.157373] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.157605] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.157958] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-6aa9d3e0-1cea-43dc-9d53-6c256951f711 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.158201] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-6aa9d3e0-1cea-43dc-9d53-6c256951f711" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.158288] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-6aa9d3e0-1cea-43dc-9d53-6c256951f711" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.158652] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-6aa9d3e0-1cea-43dc-9d53-6c256951f711" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.158823] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6aa9d3e0-1cea-43dc-9d53-6c256951f711',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.162603] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.162829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.162829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.166107] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.166363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.174391] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: UNINITIALIZED for 2s [ 720.446710] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba349899-fefa-463c-b088-f091f368c717 in Status: SUCCESS [ 720.446710] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba349899-fefa-463c-b088-f091f368c717 deletion is rescheduled due to dependency. [ 720.446924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.562857] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: SUCCESS [ 720.563147] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.662719] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.663040] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.663258] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.663597] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.663801] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.664017] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 6aa9d3e0-1cea-43dc-9d53-6c256951f711 not found, creating... [ 720.664367] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.664797] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.664925] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.665257] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.666302] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.666302] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.666302] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.666302] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.666302] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.666580] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.666580] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 6aa9d3e0-1cea-43dc-9d53-6c256951f711 is going to be created. [ 720.690826] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.691055] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.691181] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.691453] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.691736] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.691985] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-6aa9d3e0-1cea-43dc-9d53-6c256951f711" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.530100] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d24741b-a34a-41e0-b7ce-9703ce5194f1 req-17ce9872-136a-4ce8-9161-b1be5cd403a0 service nova] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_rules [ 721.530328] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d24741b-a34a-41e0-b7ce-9703ce5194f1 req-17ce9872-136a-4ce8-9161-b1be5cd403a0 service nova] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 721.530471] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d24741b-a34a-41e0-b7ce-9703ce5194f1 req-17ce9872-136a-4ce8-9161-b1be5cd403a0 service nova] Enqueued Resource ID: 6aa9d3e0-1cea-43dc-9d53-6c256951f711 with Priority: HIGHEST for action port [ 721.530708] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_rules [ 721.530837] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 721.530932] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6aa9d3e0-1cea-43dc-9d53-6c256951f711 with Priority: HIGHEST for action port [ 721.531536] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.531659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.531765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.531973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.532466] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.534192] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.534312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.534312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.535022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.535022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.535022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.535022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.535022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.535022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.535434] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.536249] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-6aa9d3e0-1cea-43dc-9d53-6c256951f711 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.536352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6aa9d3e0-1cea-43dc-9d53-6c256951f711" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.536421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6aa9d3e0-1cea-43dc-9d53-6c256951f711" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.536588] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6aa9d3e0-1cea-43dc-9d53-6c256951f711" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.536659] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6aa9d3e0-1cea-43dc-9d53-6c256951f711',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.034693] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.035136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.042025] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.042025] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6aa9d3e0-1cea-43dc-9d53-6c256951f711 with status ACTIVE [ 722.042025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.042025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.042025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.042025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.042025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.042025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.042025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.042025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.042025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.042025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.042025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.042025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.042025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.042025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.043185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.043185] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6aa9d3e0-1cea-43dc-9d53-6c256951f711 is going to be updated. [ 722.072443] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.072612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.072661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.072874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.073038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.073176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6aa9d3e0-1cea-43dc-9d53-6c256951f711" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.185689] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 722.186491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.186491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.186838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.188051] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.188051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.188051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.188051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.188051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.188051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.188051] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.550879] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.690681] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.690842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.690916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.691386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.691386] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.691555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.691555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.691646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.691723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.691816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.691956] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.692058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.692117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.692252] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.692384] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.692467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.692527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.692656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.692730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.692884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.692884] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.055577] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.055577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.055577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.055988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.055988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.055988] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be created. [ 723.090426] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.090626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.090736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.091009] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.091183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.100531] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: UNINITIALIZED for 2s [ 723.196101] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c88a973-e953-4cb7-bda1-829fc68b91a4: rpc.has_security_group_logging(os_id): False [ 723.215097] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.215097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.215097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.215097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.215097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.215388] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.215388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.215388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.215494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.215494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.215688] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.215774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.215831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.215969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.216072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.216248] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.216332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.216476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.216531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.216606] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.216705] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be created. [ 723.270995] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.271157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.271240] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.271520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.271710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.281359] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 724.514593] env[69692]: INFO networking_nsxv3.common.synchronization [req-87aef472-a359-4c03-adca-34fd6ab3ea33 req-de37ba30-2fa7-4ddf-ba6f-feefa1cd3a00 tempest-ServersAdminTestJSON-1982348900 tempest-ServersAdminTestJSON-1982348900-project-member] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 724.515462] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 724.515462] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.515687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.887887] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.888111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.888265] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.888563] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.888829] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.889268] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.889268] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.889378] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.889509] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.889662] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.889775] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.889887] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.889994] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.890116] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.890378] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.890487] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.909270] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.909270] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 724.909270] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.909534] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.909749] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-4bec53e8-b166-48d0-806a-c2adab6d94a1 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.909906] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-4bec53e8-b166-48d0-806a-c2adab6d94a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.910045] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-4bec53e8-b166-48d0-806a-c2adab6d94a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.910471] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-4bec53e8-b166-48d0-806a-c2adab6d94a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.910603] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bec53e8-b166-48d0-806a-c2adab6d94a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.109312] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: UNINITIALIZED for 4s [ 725.293706] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 725.293706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.414600] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.414600] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.414600] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.414600] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.414600] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.414600] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 4bec53e8-b166-48d0-806a-c2adab6d94a1 not found, creating... [ 725.414600] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.414600] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.415170] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.415170] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.415170] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.415569] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.415569] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.415569] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.415815] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.416490] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.418024] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 4bec53e8-b166-48d0-806a-c2adab6d94a1 is going to be created. [ 725.437808] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.438155] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.438289] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.438568] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.438821] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.439097] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-4bec53e8-b166-48d0-806a-c2adab6d94a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.820698] env[69692]: INFO networking_nsxv3.common.synchronization [req-8ae6ebb7-cd0c-423f-abec-92232e280a88 req-c714d0cb-7991-4ec6-999e-d2292d64b943 tempest-DeleteServersAdminTestJSON-1110711245 tempest-DeleteServersAdminTestJSON-1110711245-project-member] Enqueued Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_members [ 725.820698] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGHEST for action security_group_members [ 725.821277] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.821277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.821277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.821923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.821923] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.821923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.821923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.822223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.822223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.822335] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.245767] env[69692]: INFO networking_nsxv3.common.synchronization [req-30c5b334-a48f-46b2-87bc-f9fd83536d6e req-c3f0beeb-f444-44ff-94e0-e6ec7aa9c9c6 tempest-ServerDiskConfigTestJSON-756528476 tempest-ServerDiskConfigTestJSON-756528476-project-member] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 726.246304] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 726.247169] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.247169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.247169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.247169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.249435] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.249610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.249718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.249946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.250094] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.250389] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.262495] env[69692]: INFO networking_nsxv3.common.synchronization [req-f137ac09-1137-42c4-a261-c2c88a09c6dd req-9cd1c803-27db-424e-ac9e-f098eb135723 tempest-ListServersNegativeTestJSON-1033257655 tempest-ListServersNegativeTestJSON-1033257655-project-member] Enqueued Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 726.266849] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 726.266849] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.266849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.266849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.266849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.266849] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.266849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.266849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.266849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.266849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.266849] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.327673] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.327673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.327673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.327673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.327673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.327673] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.327673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.327673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.327673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.327673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.327673] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb is going to be updated. [ 726.370614] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.370614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.370802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.370935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.372427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.382142] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: IN_PROGRESS for 2s [ 726.387935] env[69692]: INFO networking_nsxv3.common.synchronization [req-87aef472-a359-4c03-adca-34fd6ab3ea33 req-9e8fe99d-c44c-427a-8537-75aae10f03e5 service nova] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_rules [ 726.387935] env[69692]: INFO networking_nsxv3.common.synchronization [req-87aef472-a359-4c03-adca-34fd6ab3ea33 req-9e8fe99d-c44c-427a-8537-75aae10f03e5 service nova] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 726.387935] env[69692]: INFO networking_nsxv3.common.synchronization [req-87aef472-a359-4c03-adca-34fd6ab3ea33 req-9e8fe99d-c44c-427a-8537-75aae10f03e5 service nova] Enqueued Resource ID: 4bec53e8-b166-48d0-806a-c2adab6d94a1 with Priority: HIGHEST for action port [ 726.388299] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_rules [ 726.388398] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 726.388451] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bec53e8-b166-48d0-806a-c2adab6d94a1 with Priority: HIGHEST for action port [ 726.389204] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.389204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.389204] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.392142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.392142] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bec53e8-b166-48d0-806a-c2adab6d94a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.392142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bec53e8-b166-48d0-806a-c2adab6d94a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.392142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bec53e8-b166-48d0-806a-c2adab6d94a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.392142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bec53e8-b166-48d0-806a-c2adab6d94a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.392142] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bec53e8-b166-48d0-806a-c2adab6d94a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.686239] env[69692]: INFO networking_nsxv3.common.synchronization [req-3a475809-3a92-4070-8bf7-917d139b773b req-62c00dbf-c678-419d-84f2-63e5a98db2e0 tempest-ListServersNegativeTestJSON-1033257655 tempest-ListServersNegativeTestJSON-1033257655-project-member] Enqueued Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 726.687050] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 with Priority: HIGHEST for action security_group_members [ 726.687050] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.688512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.753708] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.753708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.753708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.753708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.753708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.753708] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.753708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.753708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.754099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.754099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.754099] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 726.768908] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.785367] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.785534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.785585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.785774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.785910] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.796403] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 726.893051] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bec53e8-b166-48d0-806a-c2adab6d94a1 with status ACTIVE [ 726.896020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.896020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.896020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.896020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.896020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.896020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.896020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.896020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.896020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.896020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.896020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.896020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.896020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.896020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.896020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.896020] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bec53e8-b166-48d0-806a-c2adab6d94a1 is going to be updated. [ 726.916339] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.916339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.916339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.916339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.916339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.916339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bec53e8-b166-48d0-806a-c2adab6d94a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.119430] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 727.119643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.119809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.120039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.120516] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.120516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.120516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.120667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.120667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.120769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.120852] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.121729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.121855] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.123425] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.123425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.123425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.126097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.126193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.126294] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.271840] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.274647] env[69692]: INFO networking_nsxv3.common.synchronization [req-d5d820b5-cf58-4d55-a2dc-cc54fe6c7f40 req-18a07492-b4aa-471f-a3cb-69282c27f77a tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 727.274876] env[69692]: INFO networking_nsxv3.common.synchronization [req-d5d820b5-cf58-4d55-a2dc-cc54fe6c7f40 req-18a07492-b4aa-471f-a3cb-69282c27f77a tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_members [ 727.275935] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 727.275935] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_members [ 727.276090] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.276326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.276542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.276700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.276869] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.276973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.277040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.277217] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.277279] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.277375] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.278375] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.278861] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.278861] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.278861] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.279013] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.279136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.279417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.279417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.279540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.279640] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.336031] env[69692]: INFO networking_nsxv3.common.synchronization [req-d5d820b5-cf58-4d55-a2dc-cc54fe6c7f40 req-18a07492-b4aa-471f-a3cb-69282c27f77a tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_rules [ 727.336031] env[69692]: INFO networking_nsxv3.common.synchronization [req-d5d820b5-cf58-4d55-a2dc-cc54fe6c7f40 req-18a07492-b4aa-471f-a3cb-69282c27f77a tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 727.336031] env[69692]: INFO networking_nsxv3.common.synchronization [req-d5d820b5-cf58-4d55-a2dc-cc54fe6c7f40 req-18a07492-b4aa-471f-a3cb-69282c27f77a tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_rules [ 727.336031] env[69692]: INFO networking_nsxv3.common.synchronization [req-d5d820b5-cf58-4d55-a2dc-cc54fe6c7f40 req-18a07492-b4aa-471f-a3cb-69282c27f77a tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_members [ 727.336031] env[69692]: INFO networking_nsxv3.common.synchronization [req-d5d820b5-cf58-4d55-a2dc-cc54fe6c7f40 req-18a07492-b4aa-471f-a3cb-69282c27f77a tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: f6d48607-3bbc-441a-9949-a453eca068c1 with Priority: HIGHEST for action port [ 727.337672] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_rules [ 727.337672] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_rules [ 727.337672] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d48607-3bbc-441a-9949-a453eca068c1 with Priority: HIGHEST for action port [ 727.337672] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 727.337672] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_members [ 727.342269] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.342512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.342512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.342813] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.342912] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.346696] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.346696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.346696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.346696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.346696] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.346696] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6d48607-3bbc-441a-9949-a453eca068c1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.346696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.346696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.346696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.346696] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6d48607-3bbc-441a-9949-a453eca068c1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.347911] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.347911] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.347911] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.347911] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.627752] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.627888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.629232] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.779251] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.779251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.779251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.779251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.779251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.779251] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 is going to be updated. [ 727.782097] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.783139] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.788178] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d08c16f-6e84-4adf-9f6c-e889469b2991 req-33d1b904-0632-4131-8c5a-262c8b46d7c9 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 727.788330] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d08c16f-6e84-4adf-9f6c-e889469b2991 req-33d1b904-0632-4131-8c5a-262c8b46d7c9 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_members [ 727.788462] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d08c16f-6e84-4adf-9f6c-e889469b2991 req-33d1b904-0632-4131-8c5a-262c8b46d7c9 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: f4dd1b93-af3a-481d-8833-92383b938f1f with Priority: HIGHEST for action security_group_members [ 727.788680] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 727.788801] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_members [ 727.788889] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4dd1b93-af3a-481d-8833-92383b938f1f with Priority: HIGHEST for action security_group_members [ 727.789471] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.789532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.789708] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.790238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.790238] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4dd1b93-af3a-481d-8833-92383b938f1f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.790238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.790238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.790399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.790475] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.790596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.790679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.791456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.791456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.791456] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4dd1b93-af3a-481d-8833-92383b938f1f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.805256] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.805256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.805256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.805256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.805256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.812727] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: IN_PROGRESS for 2s [ 727.836380] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d08c16f-6e84-4adf-9f6c-e889469b2991 req-33d1b904-0632-4131-8c5a-262c8b46d7c9 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_rules [ 727.836380] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d08c16f-6e84-4adf-9f6c-e889469b2991 req-33d1b904-0632-4131-8c5a-262c8b46d7c9 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 727.836380] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d08c16f-6e84-4adf-9f6c-e889469b2991 req-33d1b904-0632-4131-8c5a-262c8b46d7c9 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_rules [ 727.836380] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d08c16f-6e84-4adf-9f6c-e889469b2991 req-33d1b904-0632-4131-8c5a-262c8b46d7c9 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_members [ 727.836380] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d08c16f-6e84-4adf-9f6c-e889469b2991 req-33d1b904-0632-4131-8c5a-262c8b46d7c9 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: f4dd1b93-af3a-481d-8833-92383b938f1f with Priority: HIGHEST for action security_group_rules [ 727.836380] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d08c16f-6e84-4adf-9f6c-e889469b2991 req-33d1b904-0632-4131-8c5a-262c8b46d7c9 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: f4dd1b93-af3a-481d-8833-92383b938f1f with Priority: HIGHEST for action security_group_members [ 727.836380] env[69692]: INFO networking_nsxv3.common.synchronization [req-4d08c16f-6e84-4adf-9f6c-e889469b2991 req-33d1b904-0632-4131-8c5a-262c8b46d7c9 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: f6d48607-3bbc-441a-9949-a453eca068c1 with Priority: HIGHEST for action port [ 727.836380] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_rules [ 727.840454] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_rules [ 727.840563] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4dd1b93-af3a-481d-8833-92383b938f1f with Priority: HIGHEST for action security_group_members [ 727.840657] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d48607-3bbc-441a-9949-a453eca068c1 with Priority: HIGHEST for action port [ 727.840745] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4dd1b93-af3a-481d-8833-92383b938f1f with Priority: HIGHEST for action security_group_rules [ 727.840831] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 727.840913] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_members [ 727.841941] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.842139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.842315] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.842400] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.842568] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4dd1b93-af3a-481d-8833-92383b938f1f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.842645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.842856] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6d48607-3bbc-441a-9949-a453eca068c1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.842906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.843041] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4dd1b93-af3a-481d-8833-92383b938f1f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.843135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.843194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.843478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.843518] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4dd1b93-af3a-481d-8833-92383b938f1f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.844362] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.844453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.844639] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.844728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.849531] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.849635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.849786] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.849864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.850111] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6d48607-3bbc-441a-9949-a453eca068c1 with status ACTIVE [ 727.850287] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.850512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.850581] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.850766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.850889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.851020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.851127] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.851165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.851350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.851420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.851608] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.851700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.851757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.851903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.851963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.852092] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6d48607-3bbc-441a-9949-a453eca068c1 is going to be updated. [ 727.884789] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.884932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.884988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.885207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.885348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.885501] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.885643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.885789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.885876] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6d48607-3bbc-441a-9949-a453eca068c1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.131558] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.287333] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.288698] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.292907] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4dd1b93-af3a-481d-8833-92383b938f1f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.346072] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4dd1b93-af3a-481d-8833-92383b938f1f taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.346259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.388516] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6d48607-3bbc-441a-9949-a453eca068c1 with status ACTIVE [ 728.388747] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.388883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.388964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.389213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.389310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.389501] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.389601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.389659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.389829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.389908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.390117] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.390250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.390302] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.390435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.390509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.390593] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6d48607-3bbc-441a-9949-a453eca068c1 is going to be updated. [ 728.392290] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb in Status: SUCCESS [ 728.392467] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb deletion is rescheduled due to dependency. [ 728.392562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.413406] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.413406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.413406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.413406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.413406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.413406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6d48607-3bbc-441a-9949-a453eca068c1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.565789] env[69692]: INFO networking_nsxv3.common.synchronization [req-dfc35f4d-9fbd-456e-bf6e-2a6c23f88fe4 req-8b6dce9e-392a-4288-83aa-a826e2162b24 tempest-ListImageFiltersTestJSON-1628776345 tempest-ListImageFiltersTestJSON-1628776345-project-member] Enqueued Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_members [ 728.566514] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_members [ 728.566824] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.566947] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.567134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.567363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.567524] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.567625] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.567687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.567838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.567932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.568035] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.633315] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.633475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.633549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.633795] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.633869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.633951] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 728.663331] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.663331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.663331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.663331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.663331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.671284] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 728.795799] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.795799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.795799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.795799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.795799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.795799] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 is going to be created. [ 728.795799] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.795799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.795799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.795799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.795799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.795799] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 728.800319] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4dd1b93-af3a-481d-8833-92383b938f1f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.823148] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 728.823354] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 deletion is rescheduled due to dependency. [ 728.823468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.837047] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.837047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.837047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.837047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.837047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.842665] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.842665] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.842665] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.842665] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.842665] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.846767] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: UNINITIALIZED for 2s [ 728.849589] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 729.070037] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.308170] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.308170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.308170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.308543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.308543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.308543] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4dd1b93-af3a-481d-8833-92383b938f1f is going to be created. [ 729.333963] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.334166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.334229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.334396] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.334555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.344671] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4dd1b93-af3a-481d-8833-92383b938f1f in Status: UNINITIALIZED for 2s [ 729.536994] env[69692]: INFO networking_nsxv3.common.synchronization [req-e6017f79-1429-4fb3-916a-0db71ce69716 req-36e69afd-1005-492e-8384-dab5635da882 tempest-FloatingIPsAssociationTestJSON-220159259 tempest-FloatingIPsAssociationTestJSON-220159259-project-member] Enqueued Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_members [ 729.537318] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 with Priority: HIGHEST for action security_group_members [ 729.537625] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-559d2715-9b43-4a1c-ab57-3faf644a7a85 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.537746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.537810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.538632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.539656] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.539796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.539869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.540086] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.540178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.540297] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('559d2715-9b43-4a1c-ab57-3faf644a7a85',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.572439] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.675597] env[69692]: INFO networking_nsxv3.common.synchronization [req-364758ab-7b64-40b2-8e95-399de48a8f1c req-8c158303-96cd-4072-8be5-4a8847d6c69c tempest-DeleteServersTestJSON-207338121 tempest-DeleteServersTestJSON-207338121-project-member] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 729.675597] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 729.676568] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.676568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.676568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.676568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.676568] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.676568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.676568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.676956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.676956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.676956] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.822499] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: SUCCESS [ 729.822694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.823184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.823398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.823577] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.823687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.823750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.823894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.823981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.824073] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5345cc2-0f25-4dd2-bed5-a938bfc6e247',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.045296] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.045458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.045631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.045739] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.045834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.046040] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.046147] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.046201] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.046340] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.046419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.046527] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 is going to be updated. [ 730.073921] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.074093] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.075566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.075566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.075566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.075750] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.075897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.075897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.076135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.076135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.076196] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 is going to be updated. [ 730.085965] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: IN_PROGRESS for 2s [ 730.106692] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.106692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.106692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.106898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.107194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.115923] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: IN_PROGRESS for 2s [ 730.183540] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.183717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.183791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.184032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.184165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.184351] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.184453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.184518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.184679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.184759] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.184842] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 already deleted. [ 730.184922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.318889] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.319207] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.319374] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.319583] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.319840] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.320009] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.320133] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.320399] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.324581] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.324581] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 730.324581] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.324581] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.324581] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.324581] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 730.324581] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.324581] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.326688] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.326688] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.327097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.327097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.327097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.327246] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.327319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.327394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.327511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.327585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.327715] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 is going to be updated. [ 730.344718] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.344718] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 730.344718] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.344718] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.344718] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-ccd995c3-6fd1-494e-809a-dc53a7845e8f taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.344718] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-ccd995c3-6fd1-494e-809a-dc53a7845e8f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.344718] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-ccd995c3-6fd1-494e-809a-dc53a7845e8f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.344718] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-ccd995c3-6fd1-494e-809a-dc53a7845e8f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.344718] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccd995c3-6fd1-494e-809a-dc53a7845e8f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.359782] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.359993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.359993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.360469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.360469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.369185] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: IN_PROGRESS for 2s [ 730.683615] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 730.683615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.683615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.683615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.683615] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.683615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.683615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.683615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.683615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.683615] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.848648] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.850741] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.851776] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.851776] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.851776] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.851776] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port ccd995c3-6fd1-494e-809a-dc53a7845e8f not found, creating... [ 730.852093] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.852247] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.852363] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.852600] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.852744] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.853065] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.853515] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.853515] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.853652] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.853746] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.853934] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: ccd995c3-6fd1-494e-809a-dc53a7845e8f is going to be created. [ 730.867987] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 730.867987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.867987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.867987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.867987] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.867987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.867987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.867987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.867987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.867987] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.867987] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: SUCCESS [ 730.868594] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.868854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.869421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.870354] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.870595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.870761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.872689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.872689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.872689] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.877720] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.877720] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.877720] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.877720] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.877981] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.878022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-ccd995c3-6fd1-494e-809a-dc53a7845e8f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.186294] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.356792] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4dd1b93-af3a-481d-8833-92383b938f1f in Status: SUCCESS [ 731.357117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.357117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.357599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.357599] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.357599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.358605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.358605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.358605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.358605] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4dd1b93-af3a-481d-8833-92383b938f1f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.373035] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.374278] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.602920] env[69692]: INFO networking_nsxv3.common.synchronization [req-364758ab-7b64-40b2-8e95-399de48a8f1c req-ddb6d994-1ef9-4def-8ded-8017cb5e2b9d service nova] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_rules [ 731.603120] env[69692]: INFO networking_nsxv3.common.synchronization [req-364758ab-7b64-40b2-8e95-399de48a8f1c req-ddb6d994-1ef9-4def-8ded-8017cb5e2b9d service nova] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 731.603258] env[69692]: INFO networking_nsxv3.common.synchronization [req-364758ab-7b64-40b2-8e95-399de48a8f1c req-ddb6d994-1ef9-4def-8ded-8017cb5e2b9d service nova] Enqueued Resource ID: ccd995c3-6fd1-494e-809a-dc53a7845e8f with Priority: HIGHEST for action port [ 731.604158] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_rules [ 731.604158] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 731.604158] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd995c3-6fd1-494e-809a-dc53a7845e8f with Priority: HIGHEST for action port [ 731.604365] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.604425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.604485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.604723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.604800] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.605599] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.605713] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.605784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.605978] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.606093] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.606184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.606242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.606383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.606468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.606555] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.607240] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccd995c3-6fd1-494e-809a-dc53a7845e8f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.607371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccd995c3-6fd1-494e-809a-dc53a7845e8f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.607405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccd995c3-6fd1-494e-809a-dc53a7845e8f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.607549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccd995c3-6fd1-494e-809a-dc53a7845e8f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.607625] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccd995c3-6fd1-494e-809a-dc53a7845e8f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.689036] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.861723] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4dd1b93-af3a-481d-8833-92383b938f1f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.875912] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.876742] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.099986] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 in Status: SUCCESS [ 732.100272] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 559d2715-9b43-4a1c-ab57-3faf644a7a85 deletion is rescheduled due to dependency. [ 732.100366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-559d2715-9b43-4a1c-ab57-3faf644a7a85" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.109905] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.109905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.109905] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.111646] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccd995c3-6fd1-494e-809a-dc53a7845e8f with status ACTIVE [ 732.111819] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.111922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.111983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.112718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.112718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.112718] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.112718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.112718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.113069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.113069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.113069] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.113069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.113299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.113299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.113403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.116884] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccd995c3-6fd1-494e-809a-dc53a7845e8f is going to be updated. [ 732.126282] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: IN_PROGRESS for 4s [ 732.139868] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.140014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.140096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.140334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.140476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.140628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccd995c3-6fd1-494e-809a-dc53a7845e8f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.185133] env[69692]: INFO networking_nsxv3.common.synchronization [req-386d5aed-dcd2-43ad-b7f6-40b45cd251bd req-1cb48887-6e6a-4e72-8fc1-cf172dc3c020 tempest-AttachVolumeShelveTestJSON-1120054663 tempest-AttachVolumeShelveTestJSON-1120054663-project-member] Enqueued Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_members [ 732.185133] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_members [ 732.185133] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-859b640d-3815-457c-8a5b-e9eee00dbcee taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.185133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.185133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.185133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.185695] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.186889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.186889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.186889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.186889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.186889] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.193204] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.193204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.193204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.193204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.193204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.193204] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 732.231340] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.231500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.231570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.231772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.231912] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.257285] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 732.363994] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4dd1b93-af3a-481d-8833-92383b938f1f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.377559] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 in Status: SUCCESS [ 732.377772] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5345cc2-0f25-4dd2-bed5-a938bfc6e247 deletion is rescheduled due to dependency. [ 732.377898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5345cc2-0f25-4dd2-bed5-a938bfc6e247" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.378280] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.378398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.378470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.378672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.378836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.378932] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 is going to be updated. [ 732.382268] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.382268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.382268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.382268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.382268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.382268] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 732.408673] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.408819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.408866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.409114] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.409262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.411691] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.411691] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.411691] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.411691] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.411691] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.420837] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 732.421539] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: IN_PROGRESS for 2s [ 732.558082] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.558920] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.558920] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.559658] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.559658] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.559658] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.559658] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.560398] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.560596] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.560861] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.561007] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.561155] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.561585] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.561585] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.561585] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.561716] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.579050] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.579219] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 732.580044] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.580044] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.580044] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-b173074e-8ee9-458f-8c26-64dec7000a04 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.580314] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.580314] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.580522] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.580657] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b173074e-8ee9-458f-8c26-64dec7000a04',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.611550] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.688809] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.688809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.688809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.688809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.688809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.689035] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.689082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.689128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.689301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.689413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.689636] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 859b640d-3815-457c-8a5b-e9eee00dbcee already deleted. [ 732.689636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.866397] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.866565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.866634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.866851] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.866944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.867053] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4dd1b93-af3a-481d-8833-92383b938f1f is going to be updated. [ 732.903430] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.903624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.903666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.903860] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.904022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.912197] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4dd1b93-af3a-481d-8833-92383b938f1f in Status: IN_PROGRESS for 2s [ 733.082926] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.083242] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.083400] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.083710] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.083871] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.084050] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port b173074e-8ee9-458f-8c26-64dec7000a04 not found, creating... [ 733.084307] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.084449] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.084566] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.084792] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.084929] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.085754] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.085754] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.085754] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.085754] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.085968] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.085968] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: b173074e-8ee9-458f-8c26-64dec7000a04 is going to be created. [ 733.108095] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.108323] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.108444] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.108701] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.108924] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.109158] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.113822] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.113957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.114026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.114189] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.114291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.114385] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be created. [ 733.137342] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.137498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.137498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.137729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.137887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.148084] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: UNINITIALIZED for 2s [ 733.862124] env[69692]: INFO networking_nsxv3.common.synchronization [req-386d5aed-dcd2-43ad-b7f6-40b45cd251bd req-1dd18ac3-08fd-48de-9714-7a4c8e69c1ac service nova] Enqueued Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_rules [ 733.862124] env[69692]: INFO networking_nsxv3.common.synchronization [req-386d5aed-dcd2-43ad-b7f6-40b45cd251bd req-1dd18ac3-08fd-48de-9714-7a4c8e69c1ac service nova] Enqueued Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_members [ 733.862124] env[69692]: INFO networking_nsxv3.common.synchronization [req-386d5aed-dcd2-43ad-b7f6-40b45cd251bd req-1dd18ac3-08fd-48de-9714-7a4c8e69c1ac service nova] Enqueued Resource ID: b173074e-8ee9-458f-8c26-64dec7000a04 with Priority: HIGHEST for action port [ 733.862124] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_rules [ 733.862124] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_members [ 733.862124] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b173074e-8ee9-458f-8c26-64dec7000a04 with Priority: HIGHEST for action port [ 733.863913] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-859b640d-3815-457c-8a5b-e9eee00dbcee taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.864876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.864876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.864876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.864876] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.866137] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-859b640d-3815-457c-8a5b-e9eee00dbcee taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.866137] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.866137] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.866137] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.866310] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.866424] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.866504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.866681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.866803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.867520] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.868389] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-b173074e-8ee9-458f-8c26-64dec7000a04 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.868513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.868581] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.868757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.868837] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b173074e-8ee9-458f-8c26-64dec7000a04',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.140418] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: SUCCESS [ 734.140654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.271419] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 734.271656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.271792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.272011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.272197] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.272310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.272367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.272519] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.272734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.272734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.272838] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.272911] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.272967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.273102] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.273233] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.273325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.273377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.273541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.273619] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.273691] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.273777] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.370929] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-859b640d-3815-457c-8a5b-e9eee00dbcee taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.371090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.371662] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.372563] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b173074e-8ee9-458f-8c26-64dec7000a04 with status ACTIVE [ 734.375920] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.375920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.375920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.375920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.375920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.375920] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.375920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.375920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.375920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.375920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.375920] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.375920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.375920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.375920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.375920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.375920] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b173074e-8ee9-458f-8c26-64dec7000a04 is going to be updated. [ 734.393933] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.394029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.394029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.394211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.394345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.394489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.432464] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: SUCCESS [ 734.432679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.433418] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 734.433697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.433850] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.434076] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.434886] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.434886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.434886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.435062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.435062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.435300] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.436636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.436808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.436975] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.437221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.437298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.437436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.437540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.437637] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.775425] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aade30ad-1e65-411f-be2a-2831f287cfbc: rpc.has_security_group_logging(os_id): False [ 734.798647] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.798992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.799066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.799291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.799397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.799612] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.799708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.799805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.799964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.800023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.800185] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.800301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.800355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.800498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.800580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.800748] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.800898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.800898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.801040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.802983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.803364] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be created. [ 734.815563] env[69692]: INFO networking_nsxv3.common.synchronization [req-a4511843-7269-4600-a19d-1d43acd7a682 req-2ee716c1-d3af-4bc2-b59c-933fd61fb5a5 tempest-ServerPasswordTestJSON-1505743737 tempest-ServerPasswordTestJSON-1505743737-project-member] Enqueued Resource ID: ebdff0ac-e383-4307-98b2-c7e34194e641 with Priority: HIGHEST for action security_group_members [ 734.816175] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebdff0ac-e383-4307-98b2-c7e34194e641 with Priority: HIGHEST for action security_group_members [ 734.816943] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebdff0ac-e383-4307-98b2-c7e34194e641 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.816943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.816943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.817359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.817419] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.817506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.817572] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.817751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.817826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.817913] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebdff0ac-e383-4307-98b2-c7e34194e641',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.866017] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.866017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.866017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.866017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.866017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.874976] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.877582] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 734.923400] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4dd1b93-af3a-481d-8833-92383b938f1f in Status: SUCCESS [ 734.924363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.924541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.924868] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.925076] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.927039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.927039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.927039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.927039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.927039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.927039] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4dd1b93-af3a-481d-8833-92383b938f1f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.940036] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.941044] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.159683] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 735.160170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.160436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.160648] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.160950] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.161158] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.161224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.161449] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.161531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.161614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.161701] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.246038] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-137 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.246216] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-137" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.246363] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-137" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.246702] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-137" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.246996] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.247174] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.247291] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.247520] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.247520] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.247857] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.247969] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.248107] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.248232] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.248359] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.248469] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.248600] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.271749] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.271749] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 735.271749] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.271749] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-137" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.271749] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-7f25a208-9daf-42f9-aea2-aa6516992377 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.271749] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-7f25a208-9daf-42f9-aea2-aa6516992377" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.271749] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-7f25a208-9daf-42f9-aea2-aa6516992377" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.271749] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-7f25a208-9daf-42f9-aea2-aa6516992377" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.271749] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f25a208-9daf-42f9-aea2-aa6516992377',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.320661] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.320823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.320950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.321217] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.321364] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.321609] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.321716] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.321768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.321982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.322074] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.322165] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebdff0ac-e383-4307-98b2-c7e34194e641 already deleted. [ 735.322245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.376809] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.376978] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.377084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.377918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.377918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.377918] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 859b640d-3815-457c-8a5b-e9eee00dbcee is going to be created. [ 735.399475] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.399616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.399657] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.399847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.400018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.408089] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 859b640d-3815-457c-8a5b-e9eee00dbcee in Status: UNINITIALIZED for 2s [ 735.427977] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4dd1b93-af3a-481d-8833-92383b938f1f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.441054] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.445747] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.664029] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.664183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.664227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.664442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.664646] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.664708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.664746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.664893] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.664978] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.665077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.665219] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.665310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.665370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.665515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.665648] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.665738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.665796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.665927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.666009] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.666095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.666179] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.773441] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.773744] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.773876] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.774169] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.774318] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.774474] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 7f25a208-9daf-42f9-aea2-aa6516992377 not found, creating... [ 735.774729] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.774881] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.774997] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.775224] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.775385] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.775656] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.775809] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.775924] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.776152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.776288] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.776429] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 7f25a208-9daf-42f9-aea2-aa6516992377 is going to be created. [ 735.795209] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.795392] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.795512] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.795749] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.795955] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.796178] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-7f25a208-9daf-42f9-aea2-aa6516992377" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.930162] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4dd1b93-af3a-481d-8833-92383b938f1f: rpc.has_security_group_logging(os_id): False [ 735.943338] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.943520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.943568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.943764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.943854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.943951] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 is going to be updated. [ 735.948059] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.948306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.948306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.948494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.948533] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.948640] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 735.963520] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.963669] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.963716] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.963932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.964042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.964262] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.964385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.964456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.964609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.964689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.964790] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4dd1b93-af3a-481d-8833-92383b938f1f is going to be created. [ 736.012476] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.012699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.012699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.012907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.013068] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.014859] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.014961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.014961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.015155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.015286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.029526] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: IN_PROGRESS for 2s [ 736.032707] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 736.058116] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.058251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.058522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.058638] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.058726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.077631] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4dd1b93-af3a-481d-8833-92383b938f1f in Status: IN_PROGRESS for 2s [ 736.169523] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 532815ef-03c8-40fb-91ab-292fc1c769b2: rpc.has_security_group_logging(os_id): False [ 736.190531] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.190531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.190531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.190531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.190531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.190531] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.190531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.190531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.190531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.190531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.190531] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.190531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.190531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.190531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.190531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.191108] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.191108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.191108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.191108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.195823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.195823] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be created. [ 736.316551] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.316551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.316551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.316551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.316551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.329306] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 736.559445] env[69692]: INFO networking_nsxv3.common.synchronization [req-a4511843-7269-4600-a19d-1d43acd7a682 req-24e36e80-e7b7-4d12-bd48-808178fbcf36 service nova] Enqueued Resource ID: ebdff0ac-e383-4307-98b2-c7e34194e641 with Priority: HIGHEST for action security_group_rules [ 736.559700] env[69692]: INFO networking_nsxv3.common.synchronization [req-a4511843-7269-4600-a19d-1d43acd7a682 req-24e36e80-e7b7-4d12-bd48-808178fbcf36 service nova] Enqueued Resource ID: ebdff0ac-e383-4307-98b2-c7e34194e641 with Priority: HIGHEST for action security_group_members [ 736.559900] env[69692]: INFO networking_nsxv3.common.synchronization [req-a4511843-7269-4600-a19d-1d43acd7a682 req-24e36e80-e7b7-4d12-bd48-808178fbcf36 service nova] Enqueued Resource ID: 7f25a208-9daf-42f9-aea2-aa6516992377 with Priority: HIGHEST for action port [ 736.560577] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebdff0ac-e383-4307-98b2-c7e34194e641 with Priority: HIGHEST for action security_group_rules [ 736.560765] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebdff0ac-e383-4307-98b2-c7e34194e641 with Priority: HIGHEST for action security_group_members [ 736.561237] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f25a208-9daf-42f9-aea2-aa6516992377 with Priority: HIGHEST for action port [ 736.561640] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebdff0ac-e383-4307-98b2-c7e34194e641 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.561844] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.561947] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.562253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.562389] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebdff0ac-e383-4307-98b2-c7e34194e641',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.565995] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebdff0ac-e383-4307-98b2-c7e34194e641 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.565995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.565995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.565995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.565995] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.565995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.565995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.565995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.565995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.565995] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebdff0ac-e383-4307-98b2-c7e34194e641',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.565995] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f25a208-9daf-42f9-aea2-aa6516992377 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.565995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f25a208-9daf-42f9-aea2-aa6516992377" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.565995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f25a208-9daf-42f9-aea2-aa6516992377" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.565995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f25a208-9daf-42f9-aea2-aa6516992377" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.565995] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f25a208-9daf-42f9-aea2-aa6516992377',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.889238] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 736.889238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.889589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.891025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.891025] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.070967] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebdff0ac-e383-4307-98b2-c7e34194e641 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.070967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.071486] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebdff0ac-e383-4307-98b2-c7e34194e641',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.071907] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f25a208-9daf-42f9-aea2-aa6516992377 with status ACTIVE [ 737.072102] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.072216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.072278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.072710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.072710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.072808] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.072873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.072911] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.073090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.073162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.073342] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.073429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.073488] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.073649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.073710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.073767] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f25a208-9daf-42f9-aea2-aa6516992377 is going to be updated. [ 737.105153] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.105153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.105153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.105153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.105153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.105153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f25a208-9daf-42f9-aea2-aa6516992377" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.393194] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.393194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.393194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.393644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.393883] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.394051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.394199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.394366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.394499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.394628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.394757] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.417155] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 859b640d-3815-457c-8a5b-e9eee00dbcee in Status: SUCCESS [ 737.417350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.417460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.417717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.417969] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.418527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.418527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.418527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.418527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.418527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.418713] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.582246] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebdff0ac-e383-4307-98b2-c7e34194e641',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.898048] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.898048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.898048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.898291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.898477] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.898592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.898656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.898817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.898904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.898979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.899133] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.899227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.899282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.899742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.899742] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.899742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.899742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.899941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.899941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.899941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.900054] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.920740] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.039509] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: SUCCESS [ 738.039734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.039952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.040230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.040388] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.040528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.040604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.040757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.040834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.040927] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.042284] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 738.042489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.042581] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.042753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.042915] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.043039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.043101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.043243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.043337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.043442] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.084783] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.085072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.085072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.085277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.085334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.085385] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebdff0ac-e383-4307-98b2-c7e34194e641 is going to be created. [ 738.101807] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4dd1b93-af3a-481d-8833-92383b938f1f in Status: SUCCESS [ 738.101807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.123397] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.123397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.123397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.123397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.123397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.131731] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebdff0ac-e383-4307-98b2-c7e34194e641 in Status: UNINITIALIZED for 2s [ 738.341853] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 738.342412] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.401783] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aade30ad-1e65-411f-be2a-2831f287cfbc: rpc.has_security_group_logging(os_id): False [ 738.420525] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.420525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.420525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.420827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.420827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.420939] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.421116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.421191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.421378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.421452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.421747] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.421906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.422066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.422220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.422313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.422591] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.422692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.422754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.422894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.422969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.423068] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 738.424206] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 859b640d-3815-457c-8a5b-e9eee00dbcee: rpc.has_security_group_logging(os_id): False [ 738.443506] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.443650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.443740] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.443957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.444042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.444303] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.444409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.444477] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.444617] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.444701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.444786] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 859b640d-3815-457c-8a5b-e9eee00dbcee is going to be created. [ 738.506493] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.506656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.506739] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.506948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.507167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.511212] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.511369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.511453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.511646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.511817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.519408] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 859b640d-3815-457c-8a5b-e9eee00dbcee in Status: IN_PROGRESS for 2s [ 738.520263] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 738.544968] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.546090] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.049352] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.049352] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.551116] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.551447] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.551570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.551859] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.554014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.554014] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 is going to be updated. [ 739.554014] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.554014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.554014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.554014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.554014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.555029] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 739.583768] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.583922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.583994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.584219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.584360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.586180] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.586264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.586264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.586442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.586571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.596118] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 739.596771] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: IN_PROGRESS for 2s [ 739.713031] env[69692]: INFO networking_nsxv3.common.synchronization [req-e4757f9c-5546-4f93-b78a-eaf520dce9e5 req-ba650e1e-27d8-4a36-bc67-c0687ef08cbb tempest-ServerAddressesNegativeTestJSON-902349934 tempest-ServerAddressesNegativeTestJSON-902349934-project-member] Enqueued Resource ID: 3be1563c-4654-47e8-ad88-88687976498b with Priority: HIGHEST for action security_group_members [ 739.713031] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be1563c-4654-47e8-ad88-88687976498b with Priority: HIGHEST for action security_group_members [ 739.713031] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3be1563c-4654-47e8-ad88-88687976498b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.713947] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.714048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.714315] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.714561] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.714561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.714708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.716405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.716405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.716405] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3be1563c-4654-47e8-ad88-88687976498b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.030641] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-710 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.030641] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-710" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.031011] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-710" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.031662] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-710" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.031662] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.032230] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.032230] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.033068] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.033238] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.033473] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.033587] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.033779] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.033850] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.033916] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.034016] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.034156] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.054620] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.054778] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 740.054913] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.055091] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-710" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.055376] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-c8c5405d-5b1b-4adc-bbdf-9df93a87fa88 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.055539] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-c8c5405d-5b1b-4adc-bbdf-9df93a87fa88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.055658] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-c8c5405d-5b1b-4adc-bbdf-9df93a87fa88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.055969] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-c8c5405d-5b1b-4adc-bbdf-9df93a87fa88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.056123] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8c5405d-5b1b-4adc-bbdf-9df93a87fa88',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.142062] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebdff0ac-e383-4307-98b2-c7e34194e641 in Status: UNINITIALIZED for 4s [ 740.217608] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.217766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.217837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.218278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.218278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.218368] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.218444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.218503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.218652] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.218737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.218821] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3be1563c-4654-47e8-ad88-88687976498b already deleted. [ 740.218936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.532494] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 859b640d-3815-457c-8a5b-e9eee00dbcee in Status: SUCCESS [ 740.532728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.533459] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 740.533660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.558765] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.559111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.559111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.559370] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.559513] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.559659] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port c8c5405d-5b1b-4adc-bbdf-9df93a87fa88 not found, creating... [ 740.559917] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.560092] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.560212] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.560715] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.560933] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.562143] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.562324] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.562460] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.562672] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.562822] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.562966] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: c8c5405d-5b1b-4adc-bbdf-9df93a87fa88 is going to be created. [ 740.581587] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.581791] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.581912] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.582181] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.582401] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.582608] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-c8c5405d-5b1b-4adc-bbdf-9df93a87fa88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.352038] env[69692]: INFO networking_nsxv3.common.synchronization [req-e4757f9c-5546-4f93-b78a-eaf520dce9e5 req-c5c50d6b-944d-470c-a491-10f87509c1f6 service nova] Enqueued Resource ID: 3be1563c-4654-47e8-ad88-88687976498b with Priority: HIGHEST for action security_group_rules [ 741.352038] env[69692]: INFO networking_nsxv3.common.synchronization [req-e4757f9c-5546-4f93-b78a-eaf520dce9e5 req-c5c50d6b-944d-470c-a491-10f87509c1f6 service nova] Enqueued Resource ID: 3be1563c-4654-47e8-ad88-88687976498b with Priority: HIGHEST for action security_group_members [ 741.352038] env[69692]: INFO networking_nsxv3.common.synchronization [req-e4757f9c-5546-4f93-b78a-eaf520dce9e5 req-c5c50d6b-944d-470c-a491-10f87509c1f6 service nova] Enqueued Resource ID: c8c5405d-5b1b-4adc-bbdf-9df93a87fa88 with Priority: HIGHEST for action port [ 741.352038] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be1563c-4654-47e8-ad88-88687976498b with Priority: HIGHEST for action security_group_rules [ 741.352038] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be1563c-4654-47e8-ad88-88687976498b with Priority: HIGHEST for action security_group_members [ 741.352038] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8c5405d-5b1b-4adc-bbdf-9df93a87fa88 with Priority: HIGHEST for action port [ 741.352038] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3be1563c-4654-47e8-ad88-88687976498b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.354182] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.354182] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.354182] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.354182] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3be1563c-4654-47e8-ad88-88687976498b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.355458] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3be1563c-4654-47e8-ad88-88687976498b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.355792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.356070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.356463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.358123] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.358123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.358123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.358123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.358123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.358123] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3be1563c-4654-47e8-ad88-88687976498b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.360951] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8c5405d-5b1b-4adc-bbdf-9df93a87fa88 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.364950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8c5405d-5b1b-4adc-bbdf-9df93a87fa88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.364950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8c5405d-5b1b-4adc-bbdf-9df93a87fa88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.364950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8c5405d-5b1b-4adc-bbdf-9df93a87fa88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.364950] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8c5405d-5b1b-4adc-bbdf-9df93a87fa88',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.608492] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 741.608815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.609111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.609278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.609347] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.609484] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.609688] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.609724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.609793] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.609894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.609988] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.612040] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: SUCCESS [ 741.612040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.612040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.612225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.612427] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.612527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.612570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.612798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.612888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.612976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.613095] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.856591] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3be1563c-4654-47e8-ad88-88687976498b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.856744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.868449] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3be1563c-4654-47e8-ad88-88687976498b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.869316] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8c5405d-5b1b-4adc-bbdf-9df93a87fa88 with status ACTIVE [ 741.869522] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.869652] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.869710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.869917] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.870016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.870193] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.870293] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.870417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.870569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.870654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.870834] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.870928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.870983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.871153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.871228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.871373] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8c5405d-5b1b-4adc-bbdf-9df93a87fa88 is going to be updated. [ 741.897082] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.897243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.897301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.897826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.897826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.897826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8c5405d-5b1b-4adc-bbdf-9df93a87fa88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.115335] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.115506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.115575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.115793] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.115961] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.116071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.116134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.116284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.116370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.116456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.116613] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.117155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.117155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.117155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.117155] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.117155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.117372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.117372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.117372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.117471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.117578] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.118489] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.152963] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebdff0ac-e383-4307-98b2-c7e34194e641 in Status: SUCCESS [ 742.153209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.153371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.153590] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.153777] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.153892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.153958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.154125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.154401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.154401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.154401] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebdff0ac-e383-4307-98b2-c7e34194e641',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.373158] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3be1563c-4654-47e8-ad88-88687976498b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.621077] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c88a973-e953-4cb7-bda1-829fc68b91a4: rpc.has_security_group_logging(os_id): False [ 742.622288] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2: rpc.has_security_group_logging(os_id): False [ 742.641267] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.641267] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.641267] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.641657] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.641737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.641944] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.645804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.645892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.646106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.646197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.646412] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.646515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.646581] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.646731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.646809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.647014] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.647120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.647183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.647319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.647394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.647482] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 742.649159] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.649270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.649338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.649486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.649567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.649754] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.649853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.649907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.650409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.650518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.650608] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 is going to be created. [ 742.656657] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebdff0ac-e383-4307-98b2-c7e34194e641 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.656768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.656842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.656987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.657313] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.657416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.657478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.657624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.657705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.657786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.657929] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebdff0ac-e383-4307-98b2-c7e34194e641 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.658029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.661653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.661653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.661653] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.661653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.661653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.661653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.661653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.661653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.661653] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebdff0ac-e383-4307-98b2-c7e34194e641',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.733765] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.733998] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.734082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.734438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.735462] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.741601] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.741715] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.741771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.741973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.742117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.753303] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 742.757086] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: IN_PROGRESS for 2s [ 742.879461] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.879461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.879461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.879461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.879461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.879461] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3be1563c-4654-47e8-ad88-88687976498b is going to be created. [ 742.914720] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.918016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.918016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.918016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.918016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.929404] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3be1563c-4654-47e8-ad88-88687976498b in Status: UNINITIALIZED for 2s [ 743.166289] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebdff0ac-e383-4307-98b2-c7e34194e641: rpc.has_security_group_logging(os_id): False [ 743.198166] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.198166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.198166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.198166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.198166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.198166] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.198166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.198166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.198166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.198166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.199228] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.199678] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.200028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.200874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.201066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.201369] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.203050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.203050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.203050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.203050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.203050] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebdff0ac-e383-4307-98b2-c7e34194e641 is going to be created. [ 743.303161] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.303336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.303431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.303680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.303902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.315990] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebdff0ac-e383-4307-98b2-c7e34194e641 in Status: IN_PROGRESS for 2s [ 744.771086] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 744.771749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.772680] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: SUCCESS [ 744.772976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.773285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.773595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.773768] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.774942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.775238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.775408] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.940454] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3be1563c-4654-47e8-ad88-88687976498b in Status: SUCCESS [ 744.940454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.940735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.940735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.940930] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.941145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.941227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.941446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.941539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.941623] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.941712] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3be1563c-4654-47e8-ad88-88687976498b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.013073] env[69692]: INFO networking_nsxv3.common.synchronization [req-b3a3c206-edb4-451b-b1eb-6dc118cb9fd3 req-ac6f3db4-67f3-41d8-bed2-86ea3cc0bc8c tempest-ServersAdminNegativeTestJSON-1244089969 tempest-ServersAdminNegativeTestJSON-1244089969-project-member] Enqueued Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_members [ 745.013073] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_members [ 745.013073] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.013073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.013073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.013073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.013073] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.013073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.013073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.014516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.014516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.014516] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.277045] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.277204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.277277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.277495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.277691] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.277753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.278026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.278026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.278125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.278125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.278212] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.279387] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.279498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.279561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.279749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.279897] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.279992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.282075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.282196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.282291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.282384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.282471] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.312123] env[69692]: INFO networking_nsxv3.common.synchronization [req-46580aa4-18d5-4df7-bb41-dc6c283adfcd req-793966c0-cc42-4a7f-9708-53e5149074d8 tempest-DeleteServersTestJSON-207338121 tempest-DeleteServersTestJSON-207338121-project-member] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 745.312596] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 745.312959] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.313292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.313292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.313394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.313520] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.313681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.313681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.313814] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.313904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.314528] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.331093] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebdff0ac-e383-4307-98b2-c7e34194e641 in Status: SUCCESS [ 745.331311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.444968] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3be1563c-4654-47e8-ad88-88687976498b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.445156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.445360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.445446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.445608] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.445702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.445765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.445909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.445997] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.446201] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.446261] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3be1563c-4654-47e8-ad88-88687976498b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.446329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.446392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.446530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.446663] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.446752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.446811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.446944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.447041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.447121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.447211] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3be1563c-4654-47e8-ad88-88687976498b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.521716] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.680639] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.681113] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.681113] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.681335] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.681618] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.681782] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.681900] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.682246] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.687878] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.687878] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.687878] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.687878] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.687878] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.687878] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.687878] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.687878] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.702649] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.702859] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 745.703016] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.703196] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.703571] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-c5bd16da-6e1f-4e19-98b1-58de13fdce9a taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.703840] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-c5bd16da-6e1f-4e19-98b1-58de13fdce9a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.704015] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-c5bd16da-6e1f-4e19-98b1-58de13fdce9a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.704347] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-c5bd16da-6e1f-4e19-98b1-58de13fdce9a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.704488] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5bd16da-6e1f-4e19-98b1-58de13fdce9a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.787411] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.788571] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.788571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.788748] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.789040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.789040] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.789040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.789458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.789458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.789458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.789458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.789729] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.789729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.789729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.789869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.789933] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.790947] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.791076] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.792123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.792231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.792327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.792642] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.819231] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.819231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.819231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.819231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.819231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.819231] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.819231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.819231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.819231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.819231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.819231] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 745.851911] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.852059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.852124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.852327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.852461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.860413] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 745.951086] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3be1563c-4654-47e8-ad88-88687976498b: rpc.has_security_group_logging(os_id): False [ 745.971019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.971019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.971019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.971019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.971019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.971019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.971019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.971019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.971019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.971019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.971019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.971019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.971019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.971019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.971019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.974666] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.974666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.974666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.974666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.974666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.974666] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3be1563c-4654-47e8-ad88-88687976498b is going to be created. [ 746.020757] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.032107] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.032266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.032348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.032571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.032756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.043214] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3be1563c-4654-47e8-ad88-88687976498b in Status: IN_PROGRESS for 2s [ 746.209937] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.209937] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.209937] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.209937] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.209937] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.209937] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port c5bd16da-6e1f-4e19-98b1-58de13fdce9a not found, creating... [ 746.209937] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.209937] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.209937] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.209937] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.209937] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.210908] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.210908] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.211178] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.211178] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.211561] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.211561] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: c5bd16da-6e1f-4e19-98b1-58de13fdce9a is going to be created. [ 746.235722] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.235722] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.235958] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.237044] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.237044] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.237044] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-c5bd16da-6e1f-4e19-98b1-58de13fdce9a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.294764] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2: rpc.has_security_group_logging(os_id): False [ 746.295976] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c88a973-e953-4cb7-bda1-829fc68b91a4: rpc.has_security_group_logging(os_id): False [ 746.335996] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.336212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.336257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.337063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.337063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.337063] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.337063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.337391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.337432] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.337499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.337707] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.337816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.337862] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.337999] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.338087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.338294] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.338412] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.338475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.338616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.338694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.338780] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 746.341138] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.341276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.341336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.341560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.341560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.342524] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.342524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.342524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.342524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.342524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.342813] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 is going to be updated. [ 746.458355] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.458601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.458601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.458807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.458950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.482583] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.482583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.482583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.482583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.482940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.519550] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: IN_PROGRESS for 2s [ 746.523918] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 746.524286] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.524419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.524493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.525204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.525204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.525204] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92949372-ad62-4c3b-ab83-73cb755bd4de is going to be updated. [ 746.611720] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.611953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.611953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.612157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.612302] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.633830] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: IN_PROGRESS for 2s [ 747.101341] env[69692]: INFO networking_nsxv3.common.synchronization [req-b3a3c206-edb4-451b-b1eb-6dc118cb9fd3 req-1a3049c8-5ebe-4405-9257-ef1fb076e09e service nova] Enqueued Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_rules [ 747.101628] env[69692]: INFO networking_nsxv3.common.synchronization [req-b3a3c206-edb4-451b-b1eb-6dc118cb9fd3 req-1a3049c8-5ebe-4405-9257-ef1fb076e09e service nova] Enqueued Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_members [ 747.101628] env[69692]: INFO networking_nsxv3.common.synchronization [req-b3a3c206-edb4-451b-b1eb-6dc118cb9fd3 req-1a3049c8-5ebe-4405-9257-ef1fb076e09e service nova] Enqueued Resource ID: c5bd16da-6e1f-4e19-98b1-58de13fdce9a with Priority: HIGHEST for action port [ 747.101857] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_rules [ 747.101986] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_members [ 747.102114] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5bd16da-6e1f-4e19-98b1-58de13fdce9a with Priority: HIGHEST for action port [ 747.102636] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.102812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.102845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.106709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.106709] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.106709] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.106945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.107084] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5bd16da-6e1f-4e19-98b1-58de13fdce9a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.107224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5bd16da-6e1f-4e19-98b1-58de13fdce9a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.107299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5bd16da-6e1f-4e19-98b1-58de13fdce9a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.107563] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5bd16da-6e1f-4e19-98b1-58de13fdce9a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.107658] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5bd16da-6e1f-4e19-98b1-58de13fdce9a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.611206] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.611206] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.616718] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5bd16da-6e1f-4e19-98b1-58de13fdce9a with status ACTIVE [ 747.616985] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.617136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.617731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.618104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.618325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.618688] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.618688] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.618866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.618917] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.619017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.619218] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.619317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.619371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.619514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.619589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.619673] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5bd16da-6e1f-4e19-98b1-58de13fdce9a is going to be updated. [ 747.645580] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.645735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.645805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.646016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.646155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.646308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5bd16da-6e1f-4e19-98b1-58de13fdce9a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.872753] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 747.872972] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 deletion is rescheduled due to dependency. [ 747.873106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.061254] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3be1563c-4654-47e8-ad88-88687976498b in Status: SUCCESS [ 748.061455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.431364] env[69692]: INFO networking_nsxv3.common.synchronization [req-8959b86e-3235-456e-aee8-21c361b238b4 req-941c3935-b543-4e5f-a39f-42078c45e878 tempest-ServerPasswordTestJSON-1505743737 tempest-ServerPasswordTestJSON-1505743737-project-member] Enqueued Resource ID: ebdff0ac-e383-4307-98b2-c7e34194e641 with Priority: HIGHEST for action security_group_members [ 748.432156] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebdff0ac-e383-4307-98b2-c7e34194e641 with Priority: HIGHEST for action security_group_members [ 748.432383] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebdff0ac-e383-4307-98b2-c7e34194e641 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.432546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.432615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.432890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.433758] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.433758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.433758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.433758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.433758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.433758] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebdff0ac-e383-4307-98b2-c7e34194e641',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.533582] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: SUCCESS [ 748.533848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.536057] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 748.536211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.654254] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: SUCCESS [ 748.655140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.655140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.655140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.655140] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.655384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.655384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.655384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.655483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.655538] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.936045] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.936200] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.936270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.936496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.939853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.939853] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.939853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.939853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.939853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.939853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.939853] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebdff0ac-e383-4307-98b2-c7e34194e641 is going to be updated. [ 748.965237] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.965378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.965469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.965687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.965820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.979184] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebdff0ac-e383-4307-98b2-c7e34194e641 in Status: IN_PROGRESS for 2s [ 749.162279] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.664340] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.166797] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.167052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.167131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.167414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.167449] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.167563] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92949372-ad62-4c3b-ab83-73cb755bd4de is going to be updated. [ 750.201616] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.201772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.201842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.202072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.202229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.213775] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: IN_PROGRESS for 2s [ 750.990642] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebdff0ac-e383-4307-98b2-c7e34194e641 in Status: SUCCESS [ 750.990642] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebdff0ac-e383-4307-98b2-c7e34194e641 deletion is rescheduled due to dependency. [ 750.990642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebdff0ac-e383-4307-98b2-c7e34194e641" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.227274] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: SUCCESS [ 752.227564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.227792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.229518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.229518] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.229518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.229518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.229518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.229518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.229518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.229518] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.731601] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.731800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.731874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.732115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.732478] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.732569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.732649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.732820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.734190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.734190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.734190] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.734190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.734190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.734190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.734190] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.734190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.734190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.734190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.734190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.734190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.734190] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.815830] env[69692]: INFO networking_nsxv3.common.synchronization [req-ee73bdd7-dfa8-4951-8bec-6b05655015d1 req-4d6867dc-f837-4e1d-9b2c-b88f5ff1f1d0 tempest-ServersTestFqdnHostnames-1208998322 tempest-ServersTestFqdnHostnames-1208998322-project-member] Enqueued Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGHEST for action security_group_members [ 752.816908] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGHEST for action security_group_members [ 752.816908] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8df4df4-eeff-413c-833f-3852b9a4a49a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.816908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.816908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.817153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.817769] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.817769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.817769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.817769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.817769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.817769] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.237876] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92949372-ad62-4c3b-ab83-73cb755bd4de: rpc.has_security_group_logging(os_id): False [ 753.255405] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.259097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.259097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.259097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.259097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.259097] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.259097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.259097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.259097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.259097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.259097] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.259097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.259097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.259097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.259097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.260168] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.262742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.262742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.262742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.262742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.262742] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92949372-ad62-4c3b-ab83-73cb755bd4de is going to be updated. [ 753.320247] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.320247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.320247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.320247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.320247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.320247] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.321063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.321273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.321564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.321779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.322103] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.322358] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.322529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.322814] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.323151] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.323370] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8df4df4-eeff-413c-833f-3852b9a4a49a already deleted. [ 753.324026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.334466] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: IN_PROGRESS for 2s [ 753.950762] env[69692]: INFO networking_nsxv3.common.synchronization [req-ce916028-ed31-48db-827f-f53d110047c3 req-0a9d64de-5069-46e4-8286-729461ef3aa8 tempest-ServerAddressesNegativeTestJSON-902349934 tempest-ServerAddressesNegativeTestJSON-902349934-project-member] Enqueued Resource ID: 3be1563c-4654-47e8-ad88-88687976498b with Priority: HIGHEST for action security_group_members [ 753.951624] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be1563c-4654-47e8-ad88-88687976498b with Priority: HIGHEST for action security_group_members [ 753.951979] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3be1563c-4654-47e8-ad88-88687976498b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.952151] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.952257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.952637] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.953210] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.953360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.953450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.953646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.953763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.953883] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3be1563c-4654-47e8-ad88-88687976498b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.198322] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.198322] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-538" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.198322] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-538" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.198322] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-538" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.198322] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.198322] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.198322] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.199336] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.199662] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.200021] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.200290] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.200602] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.200985] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.201289] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.202175] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.204087] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.221867] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.222152] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 754.222436] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.222662] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-538" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.223019] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-7531909f-d3d0-4ab0-bb81-462d86356413 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.223426] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-7531909f-d3d0-4ab0-bb81-462d86356413" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.223426] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-7531909f-d3d0-4ab0-bb81-462d86356413" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.223715] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-7531909f-d3d0-4ab0-bb81-462d86356413" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.223899] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7531909f-d3d0-4ab0-bb81-462d86356413',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.457823] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.458340] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.458340] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.458340] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.458468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.458710] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.458863] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.458940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.459152] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.459240] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.459340] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3be1563c-4654-47e8-ad88-88687976498b is going to be updated. [ 754.483180] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.483442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.483442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.483667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.483812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.491897] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3be1563c-4654-47e8-ad88-88687976498b in Status: IN_PROGRESS for 2s [ 754.583364] env[69692]: INFO networking_nsxv3.common.synchronization [None req-b65d0799-27aa-4f05-b3b7-0c7f582b41d8 None None] Enqueued Resource ID: ed7f0b48-8607-4213-8f4f-37ac83ff1a9b with Priority: HIGHEST for action port [ 754.583364] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7f0b48-8607-4213-8f4f-37ac83ff1a9b with Priority: HIGHEST for action port [ 754.583364] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed7f0b48-8607-4213-8f4f-37ac83ff1a9b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.583364] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed7f0b48-8607-4213-8f4f-37ac83ff1a9b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.583364] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed7f0b48-8607-4213-8f4f-37ac83ff1a9b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.584473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed7f0b48-8607-4213-8f4f-37ac83ff1a9b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.584713] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed7f0b48-8607-4213-8f4f-37ac83ff1a9b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.726441] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.726441] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.726441] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.726659] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.726659] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.726782] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 7531909f-d3d0-4ab0-bb81-462d86356413 not found, creating... [ 754.727060] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.727221] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.727361] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.727592] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.727731] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.728037] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.728279] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.728351] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.728557] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.728697] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.728877] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 7531909f-d3d0-4ab0-bb81-462d86356413 is going to be created. [ 754.750755] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.751045] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.751469] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.752077] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.752077] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.753279] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-7531909f-d3d0-4ab0-bb81-462d86356413" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.088647] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed7f0b48-8607-4213-8f4f-37ac83ff1a9b [ 755.089024] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.091178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.091276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.091460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.091565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.091670] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed7f0b48-8607-4213-8f4f-37ac83ff1a9b already deleted. [ 755.091755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed7f0b48-8607-4213-8f4f-37ac83ff1a9b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.347469] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: SUCCESS [ 755.348446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.403011] env[69692]: INFO networking_nsxv3.common.synchronization [None req-9eaf0bbb-05eb-4ac1-9a6e-2695d7e85803 None None] Enqueued Resource ID: 0eca46ee-6b44-4c60-afcd-f316ba2ad61d with Priority: HIGHEST for action port [ 755.405953] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eca46ee-6b44-4c60-afcd-f316ba2ad61d with Priority: HIGHEST for action port [ 755.405953] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eca46ee-6b44-4c60-afcd-f316ba2ad61d taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.405953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eca46ee-6b44-4c60-afcd-f316ba2ad61d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.405953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eca46ee-6b44-4c60-afcd-f316ba2ad61d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.410952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eca46ee-6b44-4c60-afcd-f316ba2ad61d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.410952] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eca46ee-6b44-4c60-afcd-f316ba2ad61d',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.911369] env[69692]: INFO networking_nsxv3.common.synchronization [None req-f47edc33-c76f-450e-ad8b-f818ed8e7b60 None None] Enqueued Resource ID: 61391d45-fb09-4dbe-8d46-c3cb5ecd716a with Priority: HIGHEST for action port [ 755.911970] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61391d45-fb09-4dbe-8d46-c3cb5ecd716a with Priority: HIGHEST for action port [ 755.912394] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-61391d45-fb09-4dbe-8d46-c3cb5ecd716a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.912578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61391d45-fb09-4dbe-8d46-c3cb5ecd716a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.912681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61391d45-fb09-4dbe-8d46-c3cb5ecd716a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.913054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61391d45-fb09-4dbe-8d46-c3cb5ecd716a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.913178] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61391d45-fb09-4dbe-8d46-c3cb5ecd716a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.921090] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0eca46ee-6b44-4c60-afcd-f316ba2ad61d [ 755.921090] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.921090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.921090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.921090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.921090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.921090] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0eca46ee-6b44-4c60-afcd-f316ba2ad61d already deleted. [ 755.921090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eca46ee-6b44-4c60-afcd-f316ba2ad61d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.962127] env[69692]: INFO networking_nsxv3.common.synchronization [None req-3a4eb51c-c201-4e89-a56e-8ce78794a3b7 tempest-ServersTestManualDisk-923673515 tempest-ServersTestManualDisk-923673515-project-member] Enqueued Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGHEST for action security_group_rules [ 755.962640] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGHEST for action security_group_rules [ 755.971650] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.971650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.971650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.971650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.971650] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3aeeb294-14c6-4fb6-bbb6-67a12deabbef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.151363] env[69692]: INFO networking_nsxv3.common.synchronization [req-ee73bdd7-dfa8-4951-8bec-6b05655015d1 req-109760f1-3a5e-46ab-a485-4c5d5546ad9b service nova] Enqueued Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGHEST for action security_group_rules [ 756.151549] env[69692]: INFO networking_nsxv3.common.synchronization [req-ee73bdd7-dfa8-4951-8bec-6b05655015d1 req-109760f1-3a5e-46ab-a485-4c5d5546ad9b service nova] Enqueued Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGHEST for action security_group_members [ 756.151728] env[69692]: INFO networking_nsxv3.common.synchronization [req-ee73bdd7-dfa8-4951-8bec-6b05655015d1 req-109760f1-3a5e-46ab-a485-4c5d5546ad9b service nova] Enqueued Resource ID: 7531909f-d3d0-4ab0-bb81-462d86356413 with Priority: HIGHEST for action port [ 756.151982] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGHEST for action security_group_rules [ 756.152139] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGHEST for action security_group_members [ 756.152240] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7531909f-d3d0-4ab0-bb81-462d86356413 with Priority: HIGHEST for action port [ 756.152839] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8df4df4-eeff-413c-833f-3852b9a4a49a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.152976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.153923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.154190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.154281] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.156589] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8df4df4-eeff-413c-833f-3852b9a4a49a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.156589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.156589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.156589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.156589] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.156589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.156589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.156589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.156589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.156589] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.159160] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-7531909f-d3d0-4ab0-bb81-462d86356413 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.159160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7531909f-d3d0-4ab0-bb81-462d86356413" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.159160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7531909f-d3d0-4ab0-bb81-462d86356413" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.159160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7531909f-d3d0-4ab0-bb81-462d86356413" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.161637] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7531909f-d3d0-4ab0-bb81-462d86356413',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.416159] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61391d45-fb09-4dbe-8d46-c3cb5ecd716a [ 756.416337] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.416491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.416789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.416789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.417374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.417374] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61391d45-fb09-4dbe-8d46-c3cb5ecd716a already deleted. [ 756.417374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61391d45-fb09-4dbe-8d46-c3cb5ecd716a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.495957] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.495957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.495957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.495957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.495957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.495957] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef already deleted. [ 756.495957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.500647] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3be1563c-4654-47e8-ad88-88687976498b in Status: SUCCESS [ 756.500883] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3be1563c-4654-47e8-ad88-88687976498b deletion is rescheduled due to dependency. [ 756.500937] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.504926] env[69692]: INFO networking_nsxv3.common.synchronization [None req-ab7c9889-2a8c-42f2-808a-f076b61930b7 tempest-ServersTestManualDisk-923673515 tempest-ServersTestManualDisk-923673515-project-member] Enqueued Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGHEST for action security_group_rules [ 756.505449] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGHEST for action security_group_rules [ 756.505736] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.505859] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.505944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.506125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.506205] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3aeeb294-14c6-4fb6-bbb6-67a12deabbef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.664073] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.664432] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8df4df4-eeff-413c-833f-3852b9a4a49a taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.664551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.664686] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7531909f-d3d0-4ab0-bb81-462d86356413 with status ACTIVE [ 756.664836] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.664932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.664993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.665214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.667247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.667247] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.667247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.667247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.667247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.667247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.667247] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.667247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.667247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.667247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.667247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.667247] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7531909f-d3d0-4ab0-bb81-462d86356413 is going to be updated. [ 756.687561] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.687660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.687660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.687870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.687999] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.689742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7531909f-d3d0-4ab0-bb81-462d86356413" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.027439] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.027739] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.027739] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.027849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.027935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.028037] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef already deleted. [ 757.028115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.170523] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.461013] env[69692]: INFO networking_nsxv3.common.synchronization [None req-e2ffb944-548e-4c09-a6f9-80233f870c97 None None] Enqueued Resource ID: dc49dda2-b837-4342-acf6-2312e5ff95b1 with Priority: HIGHEST for action port [ 757.461292] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc49dda2-b837-4342-acf6-2312e5ff95b1 with Priority: HIGHEST for action port [ 757.461969] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc49dda2-b837-4342-acf6-2312e5ff95b1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.462128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc49dda2-b837-4342-acf6-2312e5ff95b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.462193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc49dda2-b837-4342-acf6-2312e5ff95b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.462425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc49dda2-b837-4342-acf6-2312e5ff95b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.462516] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc49dda2-b837-4342-acf6-2312e5ff95b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.671752] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.671906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.671954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.672201] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.672296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.672397] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8df4df4-eeff-413c-833f-3852b9a4a49a is going to be created. [ 757.698261] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.698414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.698539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.698722] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.698933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.707997] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8df4df4-eeff-413c-833f-3852b9a4a49a in Status: UNINITIALIZED for 2s [ 757.968209] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc49dda2-b837-4342-acf6-2312e5ff95b1 [ 757.973736] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.973736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.973736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.973736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.973736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.973736] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc49dda2-b837-4342-acf6-2312e5ff95b1 already deleted. [ 757.973736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc49dda2-b837-4342-acf6-2312e5ff95b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.074926] env[69692]: INFO networking_nsxv3.common.synchronization [None req-5255ba67-a429-42af-8f94-03f0aa5c1a00 None None] Enqueued Resource ID: 38a92561-67c1-419d-a403-71d563e77b51 with Priority: HIGHEST for action port [ 758.075535] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38a92561-67c1-419d-a403-71d563e77b51 with Priority: HIGHEST for action port [ 758.075857] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-38a92561-67c1-419d-a403-71d563e77b51 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.075983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38a92561-67c1-419d-a403-71d563e77b51" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.076803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38a92561-67c1-419d-a403-71d563e77b51" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.079121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38a92561-67c1-419d-a403-71d563e77b51" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.079899] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38a92561-67c1-419d-a403-71d563e77b51',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.573589] env[69692]: INFO networking_nsxv3.common.synchronization [req-aad13598-8ac0-4e83-9543-a26d3acf1daa req-27123101-22bc-4d04-9a54-6f61a4ba1a88 tempest-ListServerFiltersTestJSON-797986437 tempest-ListServerFiltersTestJSON-797986437-project-member] Enqueued Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 758.574217] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 758.574690] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.574835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.574960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.575415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.575579] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.575682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.575753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.575914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.576378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.576378] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.582520] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38a92561-67c1-419d-a403-71d563e77b51 [ 758.582520] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.582520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.582520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.582520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.582520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.582826] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38a92561-67c1-419d-a403-71d563e77b51 already deleted. [ 758.582826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38a92561-67c1-419d-a403-71d563e77b51" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.686865] env[69692]: INFO networking_nsxv3.common.synchronization [None req-4b10ed03-0a86-4122-8bc9-c7f4c4974504 None None] Enqueued Resource ID: 77cc0806-6a48-46f4-bbe0-c70c4b37d983 with Priority: HIGHEST for action port [ 758.687123] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77cc0806-6a48-46f4-bbe0-c70c4b37d983 with Priority: HIGHEST for action port [ 758.688252] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-77cc0806-6a48-46f4-bbe0-c70c4b37d983 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.688377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77cc0806-6a48-46f4-bbe0-c70c4b37d983" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.688377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77cc0806-6a48-46f4-bbe0-c70c4b37d983" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.688627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77cc0806-6a48-46f4-bbe0-c70c4b37d983" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.688711] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77cc0806-6a48-46f4-bbe0-c70c4b37d983',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.998734] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.998924] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-941" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.999056] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-941" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.999380] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-941" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.003074] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.003283] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.003418] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.003662] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.003802] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.004014] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.004125] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.004306] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.004348] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.004434] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.004544] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.004687] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.025244] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.025534] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 759.025788] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.028435] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-941" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.028435] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.028435] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.028435] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.028435] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.028435] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.078821] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.079125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.079125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.079367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.079367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.079572] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.079636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.079779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.079829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.079881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.079969] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 already deleted. [ 759.083228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.192243] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77cc0806-6a48-46f4-bbe0-c70c4b37d983 [ 759.192243] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.192243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.192243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.192243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.192243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.192667] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77cc0806-6a48-46f4-bbe0-c70c4b37d983 already deleted. [ 759.192667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77cc0806-6a48-46f4-bbe0-c70c4b37d983" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.530340] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.530640] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.530777] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.531126] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.531214] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.531368] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef not found, creating... [ 759.531690] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.531923] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.532061] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.532538] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.532714] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.533048] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.533211] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.534028] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.534028] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.534028] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.534028] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef is going to be created. [ 759.551428] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.551623] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.551796] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.552078] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.552302] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.552516] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.717153] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8df4df4-eeff-413c-833f-3852b9a4a49a in Status: SUCCESS [ 759.717379] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.717545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.717771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.717959] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.718096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.718164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.718331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.718415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.718517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.718613] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.221054] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.368920] env[69692]: INFO networking_nsxv3.common.synchronization [req-aad13598-8ac0-4e83-9543-a26d3acf1daa req-b2d17d81-4673-4352-8f5b-eb81c227f4ae service nova] Enqueued Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_rules [ 760.369054] env[69692]: INFO networking_nsxv3.common.synchronization [req-aad13598-8ac0-4e83-9543-a26d3acf1daa req-b2d17d81-4673-4352-8f5b-eb81c227f4ae service nova] Enqueued Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 760.369205] env[69692]: INFO networking_nsxv3.common.synchronization [req-aad13598-8ac0-4e83-9543-a26d3acf1daa req-b2d17d81-4673-4352-8f5b-eb81c227f4ae service nova] Enqueued Resource ID: 2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef with Priority: HIGHEST for action port [ 760.369448] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_rules [ 760.369578] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 760.369676] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef with Priority: HIGHEST for action port [ 760.370245] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.370373] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.370441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.370736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.370826] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.375637] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.375815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.375922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.376615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.376615] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.376615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.376615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.376615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.376935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.377431] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.377948] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.378118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.378227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.378429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.378551] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.725783] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8df4df4-eeff-413c-833f-3852b9a4a49a: rpc.has_security_group_logging(os_id): False [ 760.742855] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.742933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.743020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.743422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.743554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.743769] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.743879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.743943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.744120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.744197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.744285] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8df4df4-eeff-413c-833f-3852b9a4a49a is going to be created. [ 760.797514] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.797514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.797514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.797678] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.797711] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.809603] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8df4df4-eeff-413c-833f-3852b9a4a49a in Status: IN_PROGRESS for 2s [ 760.880403] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.880594] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.880873] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.883765] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef with status ACTIVE [ 760.883765] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.883765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.883765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.883765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.883765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.883765] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.883765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.883765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.883765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.884456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.884456] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.884456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.884568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.884742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.884845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.884971] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef is going to be updated. [ 760.905520] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.905692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.905765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.905939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.906106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.906387] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d683cc2-6d15-4cfc-a2fd-bd900e6f96ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.349369] env[69692]: INFO networking_nsxv3.common.synchronization [req-3890d357-76d6-417e-86f0-8da4d782dd19 req-965f9491-c5a2-4bac-9b8a-630600bdbfab tempest-ServersAdminNegativeTestJSON-1244089969 tempest-ServersAdminNegativeTestJSON-1244089969-project-member] Enqueued Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_members [ 761.350378] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_members [ 761.350378] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.350378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.350378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.350804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.350950] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.351066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.351129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.351287] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.351373] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.351539] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.383085] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.854410] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.886173] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.886173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.886173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.886429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.886429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.886494] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 is going to be created. [ 761.909084] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.909248] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.909318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.909520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.909672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.918777] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: UNINITIALIZED for 2s [ 762.357915] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.822449] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8df4df4-eeff-413c-833f-3852b9a4a49a in Status: SUCCESS [ 762.822449] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.859770] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.861804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.861804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.861804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.861804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.861804] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92949372-ad62-4c3b-ab83-73cb755bd4de is going to be updated. [ 762.885710] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.885857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.885929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.886175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.886397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.894907] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: IN_PROGRESS for 2s [ 763.412910] env[69692]: INFO networking_nsxv3.common.synchronization [None req-cec9bb90-2baf-4168-b926-e8b423f1b3c6 None None] Enqueued Resource ID: 571777da-30a9-4af4-8954-07883b3eaea5 with Priority: HIGHEST for action port [ 763.412910] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 571777da-30a9-4af4-8954-07883b3eaea5 with Priority: HIGHEST for action port [ 763.413728] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-571777da-30a9-4af4-8954-07883b3eaea5 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.414215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-571777da-30a9-4af4-8954-07883b3eaea5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.414527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-571777da-30a9-4af4-8954-07883b3eaea5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.415803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-571777da-30a9-4af4-8954-07883b3eaea5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.415803] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('571777da-30a9-4af4-8954-07883b3eaea5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.917915] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 571777da-30a9-4af4-8954-07883b3eaea5 [ 763.918179] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.918319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.918395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.918652] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.918745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.918837] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:571777da-30a9-4af4-8954-07883b3eaea5 already deleted. [ 763.918937] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-571777da-30a9-4af4-8954-07883b3eaea5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.928277] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: SUCCESS [ 763.928485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.928616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.928822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.928981] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.929100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.929173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.929983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.929983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.929983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.929983] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.191181] env[69692]: INFO networking_nsxv3.common.synchronization [req-3e6b6647-dfed-48f3-88f4-84e74fdac950 req-03005956-c008-4bec-b507-78848946e827 tempest-SecurityGroupRulesTestJSON-635272807 tempest-SecurityGroupRulesTestJSON-635272807-project-member] Enqueued Resource ID: 085c8b9b-36a9-4004-a352-5568077a2e7b with Priority: HIGHEST for action security_group_rules [ 764.191648] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085c8b9b-36a9-4004-a352-5568077a2e7b with Priority: HIGHEST for action security_group_rules [ 764.191719] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-085c8b9b-36a9-4004-a352-5568077a2e7b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.191794] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-085c8b9b-36a9-4004-a352-5568077a2e7b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.191847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-085c8b9b-36a9-4004-a352-5568077a2e7b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.192095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-085c8b9b-36a9-4004-a352-5568077a2e7b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.192193] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('085c8b9b-36a9-4004-a352-5568077a2e7b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.431451] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.431829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.431829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.431902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.432303] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.432303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.432303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.432474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.432474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.432537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.432711] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.432816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.432876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.433025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.433166] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.433373] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.433373] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.433539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.433539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.433612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.433671] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.638079] env[69692]: INFO networking_nsxv3.common.synchronization [req-fe280af3-64a6-4219-a10d-1270266672fe req-8c0b41fb-375d-441d-822e-080ce6e49812 tempest-SecurityGroupRulesTestJSON-635272807 tempest-SecurityGroupRulesTestJSON-635272807-project-member] Enqueued Resource ID: c5893d3d-72c9-4b9e-a0b3-7af23e60d82d with Priority: HIGHEST for action security_group_rules [ 764.638640] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5893d3d-72c9-4b9e-a0b3-7af23e60d82d with Priority: HIGHEST for action security_group_rules [ 764.638972] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5893d3d-72c9-4b9e-a0b3-7af23e60d82d taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.641948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5893d3d-72c9-4b9e-a0b3-7af23e60d82d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.641948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5893d3d-72c9-4b9e-a0b3-7af23e60d82d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.642215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5893d3d-72c9-4b9e-a0b3-7af23e60d82d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.642301] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5893d3d-72c9-4b9e-a0b3-7af23e60d82d',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.710680] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.710816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.710898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.711103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.711191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.711297] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 085c8b9b-36a9-4004-a352-5568077a2e7b already deleted. [ 764.711403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-085c8b9b-36a9-4004-a352-5568077a2e7b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.906156] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: SUCCESS [ 764.906156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.941391] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b6cb33c-9436-488b-bac4-02b8d09327a1: rpc.has_security_group_logging(os_id): False [ 764.961077] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.962609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.962609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.962609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.962609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.962609] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.962609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.962609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.963177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.967362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.967362] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.967362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.967362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.967362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.967362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.967362] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.967362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.967362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.967362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.967362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.967362] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 is going to be created. [ 765.019151] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.019151] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.019151] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.019151] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.019151] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.031778] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: IN_PROGRESS for 2s [ 765.167022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.167022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.167022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.167022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.167022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.167022] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5893d3d-72c9-4b9e-a0b3-7af23e60d82d already deleted. [ 765.167022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5893d3d-72c9-4b9e-a0b3-7af23e60d82d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.271051] env[69692]: INFO networking_nsxv3.common.synchronization [req-25542473-97bb-41fc-ae06-5a5db3cee949 req-bb606990-8843-4301-9fb3-09e1937e5d8a tempest-SecurityGroupRulesTestJSON-635272807 tempest-SecurityGroupRulesTestJSON-635272807-project-member] Enqueued Resource ID: 4a0e3de0-e304-4556-987c-cb62059f420d with Priority: HIGHEST for action security_group_rules [ 765.271667] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a0e3de0-e304-4556-987c-cb62059f420d with Priority: HIGHEST for action security_group_rules [ 765.272018] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a0e3de0-e304-4556-987c-cb62059f420d taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.273476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a0e3de0-e304-4556-987c-cb62059f420d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.273476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a0e3de0-e304-4556-987c-cb62059f420d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.273476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a0e3de0-e304-4556-987c-cb62059f420d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.273476] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a0e3de0-e304-4556-987c-cb62059f420d',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.795435] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.795716] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.795716] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.795880] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.795958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.796043] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a0e3de0-e304-4556-987c-cb62059f420d already deleted. [ 765.796147] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a0e3de0-e304-4556-987c-cb62059f420d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.798213] env[69692]: INFO networking_nsxv3.common.synchronization [None req-f0aa33fe-37b6-4413-8707-c0848213308b None None] Enqueued Resource ID: 29d185e9-1ef6-43c0-9bff-518a3208ae4c with Priority: HIGHEST for action port [ 765.798213] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d185e9-1ef6-43c0-9bff-518a3208ae4c with Priority: HIGHEST for action port [ 765.798545] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-29d185e9-1ef6-43c0-9bff-518a3208ae4c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.798653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29d185e9-1ef6-43c0-9bff-518a3208ae4c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.798722] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29d185e9-1ef6-43c0-9bff-518a3208ae4c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.798940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29d185e9-1ef6-43c0-9bff-518a3208ae4c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.799294] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29d185e9-1ef6-43c0-9bff-518a3208ae4c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.033860] env[69692]: INFO networking_nsxv3.common.synchronization [req-4dba30e9-f244-4ef0-ac2d-a3993e322ff2 req-1c7beccc-8ec3-404d-97e4-98e1185d28d4 tempest-SecurityGroupRulesTestJSON-635272807 tempest-SecurityGroupRulesTestJSON-635272807-project-member] Enqueued Resource ID: f3018d9b-1dda-4cd5-a07f-b45a5934ba30 with Priority: HIGHEST for action security_group_rules [ 766.033860] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3018d9b-1dda-4cd5-a07f-b45a5934ba30 with Priority: HIGHEST for action security_group_rules [ 766.033860] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3018d9b-1dda-4cd5-a07f-b45a5934ba30 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.034167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3018d9b-1dda-4cd5-a07f-b45a5934ba30" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.034167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3018d9b-1dda-4cd5-a07f-b45a5934ba30" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.034315] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3018d9b-1dda-4cd5-a07f-b45a5934ba30" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.034402] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3018d9b-1dda-4cd5-a07f-b45a5934ba30',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.301366] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29d185e9-1ef6-43c0-9bff-518a3208ae4c [ 766.301674] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.301775] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.302569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.302569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.302569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.302569] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29d185e9-1ef6-43c0-9bff-518a3208ae4c already deleted. [ 766.302569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29d185e9-1ef6-43c0-9bff-518a3208ae4c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.508432] env[69692]: INFO networking_nsxv3.common.synchronization [req-417ce648-805c-42c0-994e-992f50d343a6 req-d9a392e4-499e-476c-ad99-54a6e4723696 tempest-SecurityGroupRulesTestJSON-635272807 tempest-SecurityGroupRulesTestJSON-635272807-project-member] Enqueued Resource ID: a29c6b14-2f52-4c0a-b923-567d75edd284 with Priority: HIGHEST for action security_group_rules [ 766.508824] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29c6b14-2f52-4c0a-b923-567d75edd284 with Priority: HIGHEST for action security_group_rules [ 766.509173] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a29c6b14-2f52-4c0a-b923-567d75edd284 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.509289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a29c6b14-2f52-4c0a-b923-567d75edd284" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.509360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a29c6b14-2f52-4c0a-b923-567d75edd284" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.509616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a29c6b14-2f52-4c0a-b923-567d75edd284" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.509702] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a29c6b14-2f52-4c0a-b923-567d75edd284',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.554833] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.554970] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.555050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.555260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.555566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.555566] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3018d9b-1dda-4cd5-a07f-b45a5934ba30 already deleted. [ 766.555566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3018d9b-1dda-4cd5-a07f-b45a5934ba30" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.621873] env[69692]: INFO networking_nsxv3.common.synchronization [req-2c69bce7-04ef-44b6-aadb-c742eb118261 req-290f649c-f5a2-4534-a84c-6e402fab1162 tempest-SecurityGroupRulesTestJSON-635272807 tempest-SecurityGroupRulesTestJSON-635272807-project-member] Enqueued Resource ID: a29c6b14-2f52-4c0a-b923-567d75edd284 with Priority: HIGHEST for action security_group_rules [ 766.622282] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29c6b14-2f52-4c0a-b923-567d75edd284 with Priority: HIGHEST for action security_group_rules [ 766.622600] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a29c6b14-2f52-4c0a-b923-567d75edd284 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.622707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a29c6b14-2f52-4c0a-b923-567d75edd284" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.769635] env[69692]: INFO networking_nsxv3.common.synchronization [req-1d2450f3-6259-486f-9099-3a461c746dae req-efca7432-d42a-4dd4-b431-c3110643e2d5 tempest-SecurityGroupRulesTestJSON-635272807 tempest-SecurityGroupRulesTestJSON-635272807-project-member] Enqueued Resource ID: a29c6b14-2f52-4c0a-b923-567d75edd284 with Priority: HIGHEST for action security_group_rules [ 766.770149] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29c6b14-2f52-4c0a-b923-567d75edd284 with Priority: HIGHEST for action security_group_rules [ 766.770791] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a29c6b14-2f52-4c0a-b923-567d75edd284 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.771096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a29c6b14-2f52-4c0a-b923-567d75edd284" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.035806] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.036066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.036066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.036242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.036335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.036441] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a29c6b14-2f52-4c0a-b923-567d75edd284 already deleted. [ 767.036564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a29c6b14-2f52-4c0a-b923-567d75edd284" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.036657] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a29c6b14-2f52-4c0a-b923-567d75edd284" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.036834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a29c6b14-2f52-4c0a-b923-567d75edd284" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.036918] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a29c6b14-2f52-4c0a-b923-567d75edd284',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.045538] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: SUCCESS [ 767.045752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.560116] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.560276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.560347] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.560616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.560725] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.560824] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a29c6b14-2f52-4c0a-b923-567d75edd284 already deleted. [ 767.560906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a29c6b14-2f52-4c0a-b923-567d75edd284" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.561416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a29c6b14-2f52-4c0a-b923-567d75edd284" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.561602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a29c6b14-2f52-4c0a-b923-567d75edd284" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.561693] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a29c6b14-2f52-4c0a-b923-567d75edd284',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.893819] env[69692]: INFO networking_nsxv3.common.synchronization [req-6210e33a-355d-4743-901b-938210608927 req-3b827cad-b741-4460-b2ab-3c86ec1f53a8 tempest-ServersWithSpecificFlavorTestJSON-467341840 tempest-ServersWithSpecificFlavorTestJSON-467341840-project-member] Enqueued Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_members [ 767.895949] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_members [ 767.896113] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.896239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.896303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.896498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.896649] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.896747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.896808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.896951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.897048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.897141] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.096888] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.097195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.097195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.097456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.097456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.101162] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a29c6b14-2f52-4c0a-b923-567d75edd284 already deleted. [ 768.101463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a29c6b14-2f52-4c0a-b923-567d75edd284" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.399136] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.399307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.399645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.399891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.399990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.400209] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.400306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.400367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.400522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.401363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.401363] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 is going to be updated. [ 768.430273] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.430423] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.430493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.430799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.430873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.438823] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 in Status: IN_PROGRESS for 2s [ 769.923142] env[69692]: INFO networking_nsxv3.common.synchronization [req-93ba705f-9f0f-4546-9863-b8f1d1bc7860 req-8d482378-e9d2-48a4-8e07-77bb137ac636 tempest-ListServerFiltersTestJSON-797986437 tempest-ListServerFiltersTestJSON-797986437-project-member] Enqueued Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 769.923142] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 769.923142] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.923142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.923142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.923616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.923863] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.924105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.924247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.925250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.925350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.925451] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.243909] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.244115] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-941" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.244237] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-941" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.244518] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-941" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.244750] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.244896] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.245019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.245226] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.245362] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.245566] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.248022] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.248022] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.248022] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.248022] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 770.248022] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.248022] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.264198] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.264368] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 770.264506] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.264680] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-941" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.264983] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-a96cf17a-894b-475d-82be-6cd4742150ca taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.265185] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-a96cf17a-894b-475d-82be-6cd4742150ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.265305] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-a96cf17a-894b-475d-82be-6cd4742150ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.265614] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-a96cf17a-894b-475d-82be-6cd4742150ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.265758] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a96cf17a-894b-475d-82be-6cd4742150ca',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.427528] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.448478] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 in Status: SUCCESS [ 770.448659] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 deletion is rescheduled due to dependency. [ 770.448768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.768379] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.768755] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.768885] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.769235] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.769421] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.769553] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port a96cf17a-894b-475d-82be-6cd4742150ca not found, creating... [ 770.770202] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.770202] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.770202] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.770376] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.770456] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.770809] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.770965] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.771687] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.772028] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.772353] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.772524] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: a96cf17a-894b-475d-82be-6cd4742150ca is going to be created. [ 770.795086] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.795086] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.795086] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.795086] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.795086] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.795400] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-a96cf17a-894b-475d-82be-6cd4742150ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.931427] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.434571] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.434755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.434829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.435090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.435185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.435299] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 is going to be updated. [ 771.469028] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.469028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.469028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.469028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.469028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.482016] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: IN_PROGRESS for 2s [ 771.575291] env[69692]: INFO networking_nsxv3.common.synchronization [req-93ba705f-9f0f-4546-9863-b8f1d1bc7860 req-8e7415e9-747d-471c-99ac-df43874ce8a2 service nova] Enqueued Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_rules [ 771.575474] env[69692]: INFO networking_nsxv3.common.synchronization [req-93ba705f-9f0f-4546-9863-b8f1d1bc7860 req-8e7415e9-747d-471c-99ac-df43874ce8a2 service nova] Enqueued Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 771.575610] env[69692]: INFO networking_nsxv3.common.synchronization [req-93ba705f-9f0f-4546-9863-b8f1d1bc7860 req-8e7415e9-747d-471c-99ac-df43874ce8a2 service nova] Enqueued Resource ID: a96cf17a-894b-475d-82be-6cd4742150ca with Priority: HIGHEST for action port [ 771.575888] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_rules [ 771.576211] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 771.576354] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a96cf17a-894b-475d-82be-6cd4742150ca with Priority: HIGHEST for action port [ 771.576972] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.577132] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.577179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.577368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.577454] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.580276] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.580276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.580276] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-a96cf17a-894b-475d-82be-6cd4742150ca taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.580276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a96cf17a-894b-475d-82be-6cd4742150ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.580276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a96cf17a-894b-475d-82be-6cd4742150ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.580276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a96cf17a-894b-475d-82be-6cd4742150ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.580276] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a96cf17a-894b-475d-82be-6cd4742150ca',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.896343] env[69692]: INFO networking_nsxv3.common.synchronization [None req-6a96586e-3d1c-4555-bb66-f86afbbd0fe6 None None] Enqueued Resource ID: 087809d3-dd52-4f8e-92cc-39c2a5d72a9b with Priority: HIGHEST for action port [ 771.896770] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 087809d3-dd52-4f8e-92cc-39c2a5d72a9b with Priority: HIGHEST for action port [ 771.897189] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-087809d3-dd52-4f8e-92cc-39c2a5d72a9b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.897316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-087809d3-dd52-4f8e-92cc-39c2a5d72a9b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.897384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-087809d3-dd52-4f8e-92cc-39c2a5d72a9b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.897642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-087809d3-dd52-4f8e-92cc-39c2a5d72a9b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.897728] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('087809d3-dd52-4f8e-92cc-39c2a5d72a9b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.080709] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.082103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.082103] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a96cf17a-894b-475d-82be-6cd4742150ca with status ACTIVE [ 772.082103] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.082103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.082103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.082995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.082995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.082995] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.082995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.082995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.083221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.083336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.083562] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.083684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.083774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.083951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.084096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.084243] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a96cf17a-894b-475d-82be-6cd4742150ca is going to be updated. [ 772.111543] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.111543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.111543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.111543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.111543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.111543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a96cf17a-894b-475d-82be-6cd4742150ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.402219] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 087809d3-dd52-4f8e-92cc-39c2a5d72a9b [ 772.402219] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.402219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.402219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.402360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.402360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.402458] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:087809d3-dd52-4f8e-92cc-39c2a5d72a9b already deleted. [ 772.402542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-087809d3-dd52-4f8e-92cc-39c2a5d72a9b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.869569] env[69692]: INFO networking_nsxv3.common.synchronization [None req-59917047-38ff-45e4-9550-f4f21ba47173 tempest-ServerActionsTestJSON-532161054 tempest-ServerActionsTestJSON-532161054-project-member] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_rules [ 772.870155] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_rules [ 772.870581] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.870655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.870712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.870994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.871294] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.976284] env[69692]: INFO networking_nsxv3.common.synchronization [None req-0800fc60-facc-4f92-a98b-38d988d5d9b3 tempest-ServerActionsTestJSON-532161054 tempest-ServerActionsTestJSON-532161054-project-member] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_rules [ 772.976801] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_rules [ 772.977109] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.977854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.098459] env[69692]: INFO networking_nsxv3.common.synchronization [None req-5b8c4d37-a378-41fd-9c08-b0da13ab3a48 None None] Enqueued Resource ID: 2d341724-fbe6-4dd9-bd67-c90ebeb2e377 with Priority: HIGHEST for action port [ 773.098459] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d341724-fbe6-4dd9-bd67-c90ebeb2e377 with Priority: HIGHEST for action port [ 773.098459] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d341724-fbe6-4dd9-bd67-c90ebeb2e377 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.098459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d341724-fbe6-4dd9-bd67-c90ebeb2e377" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.099130] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d341724-fbe6-4dd9-bd67-c90ebeb2e377" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.099404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d341724-fbe6-4dd9-bd67-c90ebeb2e377" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.099562] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d341724-fbe6-4dd9-bd67-c90ebeb2e377',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.394882] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.395073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.395315] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.395740] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.396028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.396297] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 already deleted. [ 773.396543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.396921] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.397571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.397571] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.493034] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: SUCCESS [ 773.493034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.493034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.493034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.493034] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.493034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.493034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.493034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.493034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.493034] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.604477] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d341724-fbe6-4dd9-bd67-c90ebeb2e377 [ 773.604927] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.604927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.604927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.605931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.605931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.605931] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d341724-fbe6-4dd9-bd67-c90ebeb2e377 already deleted. [ 773.605931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d341724-fbe6-4dd9-bd67-c90ebeb2e377" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.875022] env[69692]: INFO networking_nsxv3.common.synchronization [None req-50389797-00bf-4aa9-99cb-de4fec561b74 None None] Enqueued Resource ID: 0cad8bc8-4b6f-46f8-9366-0a1f15d209fe with Priority: HIGHEST for action port [ 773.875022] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cad8bc8-4b6f-46f8-9366-0a1f15d209fe with Priority: HIGHEST for action port [ 773.875022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cad8bc8-4b6f-46f8-9366-0a1f15d209fe taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.875022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cad8bc8-4b6f-46f8-9366-0a1f15d209fe" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.875022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cad8bc8-4b6f-46f8-9366-0a1f15d209fe" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.875022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cad8bc8-4b6f-46f8-9366-0a1f15d209fe" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.875022] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cad8bc8-4b6f-46f8-9366-0a1f15d209fe',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.919274] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.919431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.919480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.919673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.919772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.919883] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 already deleted. [ 773.919968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.997625] env[69692]: INFO networking_nsxv3.common.synchronization [None req-1861e55c-60c2-4b20-ae98-5f9464712e8d tempest-AttachVolumeTestJSON-1369618715 tempest-AttachVolumeTestJSON-1369618715-project-member] Enqueued Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGHEST for action security_group_rules [ 774.002546] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.002546] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGHEST for action security_group_rules [ 774.002546] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.002546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.002546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.002546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.002546] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.379835] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0cad8bc8-4b6f-46f8-9366-0a1f15d209fe [ 774.379835] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.380167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.380167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.380167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.380294] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.380336] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0cad8bc8-4b6f-46f8-9366-0a1f15d209fe already deleted. [ 774.380403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cad8bc8-4b6f-46f8-9366-0a1f15d209fe" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.401409] env[69692]: INFO networking_nsxv3.common.synchronization [None req-bf77489b-dc2e-43c5-b396-01110f9a2957 tempest-AttachVolumeTestJSON-1369618715 tempest-AttachVolumeTestJSON-1369618715-project-member] Enqueued Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGHEST for action security_group_rules [ 774.401409] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGHEST for action security_group_rules [ 774.401409] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.401409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.502678] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.522250] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.522835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.523058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.523329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.523445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.523574] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 already deleted. [ 774.523669] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.524151] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.524332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.524421] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.009020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.009020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.009020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.009020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.009020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.009020] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 is going to be updated. [ 775.039885] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.039885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.039885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.039885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.039885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.045173] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.045173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.045173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.045173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.045173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.045173] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 already deleted. [ 775.045173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.046173] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: IN_PROGRESS for 2s [ 775.211104] env[69692]: INFO networking_nsxv3.common.synchronization [None req-8546f76d-7265-40ee-ab3d-29869a3d22b9 None None] Enqueued Resource ID: 1b15848d-92e1-454b-a95c-306cc0a6cef1 with Priority: HIGHEST for action port [ 775.211355] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b15848d-92e1-454b-a95c-306cc0a6cef1 with Priority: HIGHEST for action port [ 775.212330] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b15848d-92e1-454b-a95c-306cc0a6cef1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.212455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b15848d-92e1-454b-a95c-306cc0a6cef1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.212527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b15848d-92e1-454b-a95c-306cc0a6cef1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.212778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b15848d-92e1-454b-a95c-306cc0a6cef1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.212863] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b15848d-92e1-454b-a95c-306cc0a6cef1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.721131] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b15848d-92e1-454b-a95c-306cc0a6cef1 [ 775.721131] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.721131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.721131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.721131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.721131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.721131] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b15848d-92e1-454b-a95c-306cc0a6cef1 already deleted. [ 775.721131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b15848d-92e1-454b-a95c-306cc0a6cef1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.899939] env[69692]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] NSXv3 Agent Agent loop - iteration:0 completed [ 775.900045] env[69692]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] NSXv3 Agent Agent loop - iteration:1 started [ 777.058107] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: SUCCESS [ 777.058357] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.058501] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.058731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.058918] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.059153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.059153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.059274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.059354] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.059438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.059529] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.561925] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.561925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.561925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.561925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.562102] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.562197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.562261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.562408] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.562505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.562575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.562808] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.562992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.562992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.563101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.563241] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.563362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.563392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.563515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.563588] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.563666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.563757] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.067060] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b6cb33c-9436-488b-bac4-02b8d09327a1: rpc.has_security_group_logging(os_id): False [ 778.083517] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.083655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.083720] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.083923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.084036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.084466] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.084650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.084755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.085010] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.085217] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.085442] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.085589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.085668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.085874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.085995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.086232] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.086381] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.086455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.086624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.086741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.086836] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 is going to be updated. [ 778.147145] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.147336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.147378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.147580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.148961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.172657] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: IN_PROGRESS for 2s [ 780.189968] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: SUCCESS [ 780.190225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.216352] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 780.216450] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 781.954242] env[69692]: INFO networking_nsxv3.common.synchronization [req-f802b1bd-6ca9-44f5-86cb-65ead827c88a req-d7919744-4a49-45b7-95cc-149c7590da7e tempest-ListImageFiltersTestJSON-1628776345 tempest-ListImageFiltersTestJSON-1628776345-project-member] Enqueued Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_members [ 781.954242] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 with Priority: HIGHEST for action security_group_members [ 781.954242] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3f4ecb4-733b-4e4f-a088-b50706c8f083 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.954242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.954242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.954242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.954242] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.959991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.959991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.959991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.959991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.959991] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3f4ecb4-733b-4e4f-a088-b50706c8f083',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.140573] env[69692]: INFO networking_nsxv3.common.synchronization [req-9fc2dbcd-6fae-4344-bce8-baba75253d23 req-81dd6411-8975-4757-9b72-ae24e5409343 tempest-ListServerFiltersTestJSON-797986437 tempest-ListServerFiltersTestJSON-797986437-project-member] Enqueued Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 782.141066] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 782.141389] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.141808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.141890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.145073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.145484] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.145484] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.145484] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.146685] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.146685] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.146685] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.457934] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.458134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.458216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.458435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.458534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.458791] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.458916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.458916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.459185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.459378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.459473] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 is going to be updated. [ 782.491239] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.491385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.491458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.491805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.491912] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.501114] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: IN_PROGRESS for 2s [ 782.530277] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.530471] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-941" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.530598] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-941" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.530950] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-941" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.532095] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.532271] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.532396] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.532626] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.532885] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.533080] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.533120] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.533256] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.533303] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.533415] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.533518] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.533665] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.553198] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.553198] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 782.553554] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.555640] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-941" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.555640] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-16ad7ca6-1b2f-44ad-9f6b-441b0f24e581 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.555640] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-16ad7ca6-1b2f-44ad-9f6b-441b0f24e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.555640] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-16ad7ca6-1b2f-44ad-9f6b-441b0f24e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.555640] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-16ad7ca6-1b2f-44ad-9f6b-441b0f24e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.555640] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16ad7ca6-1b2f-44ad-9f6b-441b0f24e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.567140] env[69692]: INFO networking_nsxv3.common.synchronization [None req-2b8c01d2-fbfe-462f-ab00-49c9d8cef529 None None] Enqueued Resource ID: 77e1c0b7-d210-4c26-b274-17cb59a35d5b with Priority: HIGHEST for action port [ 782.567140] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e1c0b7-d210-4c26-b274-17cb59a35d5b with Priority: HIGHEST for action port [ 782.567140] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-77e1c0b7-d210-4c26-b274-17cb59a35d5b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.567140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77e1c0b7-d210-4c26-b274-17cb59a35d5b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.567140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77e1c0b7-d210-4c26-b274-17cb59a35d5b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.567140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77e1c0b7-d210-4c26-b274-17cb59a35d5b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.567140] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77e1c0b7-d210-4c26-b274-17cb59a35d5b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.649075] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.060370] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.060370] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.060370] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.060370] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.060370] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.060370] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 16ad7ca6-1b2f-44ad-9f6b-441b0f24e581 not found, creating... [ 783.060370] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.060370] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.060370] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.060370] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.060370] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.060905] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.060905] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.060905] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.060905] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.060905] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.060905] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 16ad7ca6-1b2f-44ad-9f6b-441b0f24e581 is going to be created. [ 783.070031] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77e1c0b7-d210-4c26-b274-17cb59a35d5b [ 783.070090] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.070197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.070833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.070833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.070833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.070833] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77e1c0b7-d210-4c26-b274-17cb59a35d5b already deleted. [ 783.070833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77e1c0b7-d210-4c26-b274-17cb59a35d5b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.094980] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.095215] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.095346] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.095703] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.096042] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.096300] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-16ad7ca6-1b2f-44ad-9f6b-441b0f24e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.152068] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.655310] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.655651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.655780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.656149] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.656308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.656461] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 is going to be updated. [ 783.692860] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.693063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.693178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.693423] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.693726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.704879] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: IN_PROGRESS for 2s [ 783.822333] env[69692]: INFO networking_nsxv3.common.synchronization [req-9fc2dbcd-6fae-4344-bce8-baba75253d23 req-c553ccb6-d3f6-4290-94b2-b8f62a2bd1cb service nova] Enqueued Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_rules [ 783.822519] env[69692]: INFO networking_nsxv3.common.synchronization [req-9fc2dbcd-6fae-4344-bce8-baba75253d23 req-c553ccb6-d3f6-4290-94b2-b8f62a2bd1cb service nova] Enqueued Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 783.822661] env[69692]: INFO networking_nsxv3.common.synchronization [req-9fc2dbcd-6fae-4344-bce8-baba75253d23 req-c553ccb6-d3f6-4290-94b2-b8f62a2bd1cb service nova] Enqueued Resource ID: 16ad7ca6-1b2f-44ad-9f6b-441b0f24e581 with Priority: HIGHEST for action port [ 783.822899] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_rules [ 783.823039] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 783.823141] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ad7ca6-1b2f-44ad-9f6b-441b0f24e581 with Priority: HIGHEST for action port [ 783.823696] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.823825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.825501] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.825501] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.825501] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.826452] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.826452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.826589] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-16ad7ca6-1b2f-44ad-9f6b-441b0f24e581 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.826788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16ad7ca6-1b2f-44ad-9f6b-441b0f24e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.826788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16ad7ca6-1b2f-44ad-9f6b-441b0f24e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.828028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16ad7ca6-1b2f-44ad-9f6b-441b0f24e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.828028] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16ad7ca6-1b2f-44ad-9f6b-441b0f24e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.334131] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.334131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.334131] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16ad7ca6-1b2f-44ad-9f6b-441b0f24e581 with status ACTIVE [ 784.334131] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.334131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.334131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.334131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.334131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.334131] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.334131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.334131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.334131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.334131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.334131] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.334785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.334785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.334785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.334785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.334785] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16ad7ca6-1b2f-44ad-9f6b-441b0f24e581 is going to be updated. [ 784.355844] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.355991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.356073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.356265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.356395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.356574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16ad7ca6-1b2f-44ad-9f6b-441b0f24e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.510954] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 in Status: SUCCESS [ 784.511167] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3f4ecb4-733b-4e4f-a088-b50706c8f083 deletion is rescheduled due to dependency. [ 784.511282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3f4ecb4-733b-4e4f-a088-b50706c8f083" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.655631] env[69692]: INFO networking_nsxv3.common.synchronization [req-36468014-5b6a-4bde-b2b5-aecdc95b096e req-53184315-afaa-441a-9f0a-dd5bf8fb987e tempest-VolumesAdminNegativeTest-1078272547 tempest-VolumesAdminNegativeTest-1078272547-project-member] Enqueued Resource ID: b6ffdfa8-6380-47fd-b801-823581edd625 with Priority: HIGHEST for action security_group_members [ 784.656270] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6ffdfa8-6380-47fd-b801-823581edd625 with Priority: HIGHEST for action security_group_members [ 784.656906] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6ffdfa8-6380-47fd-b801-823581edd625 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.657251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.657462] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.658635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.658762] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.659045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.659145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.659345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.659480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.659600] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6ffdfa8-6380-47fd-b801-823581edd625',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.684314] env[69692]: INFO networking_nsxv3.common.synchronization [None req-1e38f92e-261a-4df3-83e5-ddedd96ecb40 None None] Enqueued Resource ID: 194a6cb4-0c30-487a-a571-8b393393bbc7 with Priority: HIGHEST for action port [ 784.684513] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194a6cb4-0c30-487a-a571-8b393393bbc7 with Priority: HIGHEST for action port [ 784.685049] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-194a6cb4-0c30-487a-a571-8b393393bbc7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.685178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-194a6cb4-0c30-487a-a571-8b393393bbc7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.685240] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-194a6cb4-0c30-487a-a571-8b393393bbc7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.685503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-194a6cb4-0c30-487a-a571-8b393393bbc7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.685585] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('194a6cb4-0c30-487a-a571-8b393393bbc7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.088796] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.089053] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-267" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.089185] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-267" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.089767] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-267" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.090048] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.090215] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.090337] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.090562] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.090785] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.091028] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 785.091146] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.091266] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.091375] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.091498] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 785.091586] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.091740] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.109479] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.109972] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 785.109972] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.109972] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-267" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.110299] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-d35e4595-6665-4073-9844-44a2c9afdc19 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.110472] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-d35e4595-6665-4073-9844-44a2c9afdc19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.110592] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-d35e4595-6665-4073-9844-44a2c9afdc19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.110952] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-d35e4595-6665-4073-9844-44a2c9afdc19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.111120] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d35e4595-6665-4073-9844-44a2c9afdc19',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.164611] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.164611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.164611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.164611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.164611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.164611] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.164611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.164611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.164611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.164611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.164611] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6ffdfa8-6380-47fd-b801-823581edd625 already deleted. [ 785.164611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.189198] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 194a6cb4-0c30-487a-a571-8b393393bbc7 [ 785.189389] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.189532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.189601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.189802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.189886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.189980] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:194a6cb4-0c30-487a-a571-8b393393bbc7 already deleted. [ 785.190073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-194a6cb4-0c30-487a-a571-8b393393bbc7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.614354] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.614724] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.614724] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.614930] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.615091] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.615247] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port d35e4595-6665-4073-9844-44a2c9afdc19 not found, creating... [ 785.615506] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.615659] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.615775] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.615994] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.616232] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.616506] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.616660] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.616803] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.617028] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.617168] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.617306] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: d35e4595-6665-4073-9844-44a2c9afdc19 is going to be created. [ 785.636909] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.637095] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.637219] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.637443] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.637663] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.637871] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-d35e4595-6665-4073-9844-44a2c9afdc19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.714310] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: SUCCESS [ 785.714530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.714686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.714890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.715079] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.715193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.715259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.715414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.715489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.715584] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.217547] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.380585] env[69692]: INFO networking_nsxv3.common.synchronization [req-36468014-5b6a-4bde-b2b5-aecdc95b096e req-8a553978-0dd6-4967-b579-f74d3f9729b8 service nova] Enqueued Resource ID: b6ffdfa8-6380-47fd-b801-823581edd625 with Priority: HIGHEST for action security_group_rules [ 786.380770] env[69692]: INFO networking_nsxv3.common.synchronization [req-36468014-5b6a-4bde-b2b5-aecdc95b096e req-8a553978-0dd6-4967-b579-f74d3f9729b8 service nova] Enqueued Resource ID: b6ffdfa8-6380-47fd-b801-823581edd625 with Priority: HIGHEST for action security_group_members [ 786.380925] env[69692]: INFO networking_nsxv3.common.synchronization [req-36468014-5b6a-4bde-b2b5-aecdc95b096e req-8a553978-0dd6-4967-b579-f74d3f9729b8 service nova] Enqueued Resource ID: d35e4595-6665-4073-9844-44a2c9afdc19 with Priority: HIGHEST for action port [ 786.381172] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6ffdfa8-6380-47fd-b801-823581edd625 with Priority: HIGHEST for action security_group_rules [ 786.381297] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6ffdfa8-6380-47fd-b801-823581edd625 with Priority: HIGHEST for action security_group_members [ 786.381390] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d35e4595-6665-4073-9844-44a2c9afdc19 with Priority: HIGHEST for action port [ 786.382490] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6ffdfa8-6380-47fd-b801-823581edd625 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.384017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.384017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.384017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.384017] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6ffdfa8-6380-47fd-b801-823581edd625',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.384817] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6ffdfa8-6380-47fd-b801-823581edd625 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.384924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.384990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.385171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.385315] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.385423] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.385498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.385602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.385683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.385767] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6ffdfa8-6380-47fd-b801-823581edd625',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.387788] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-d35e4595-6665-4073-9844-44a2c9afdc19 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.388697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d35e4595-6665-4073-9844-44a2c9afdc19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.388697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d35e4595-6665-4073-9844-44a2c9afdc19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.388697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d35e4595-6665-4073-9844-44a2c9afdc19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.388697] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d35e4595-6665-4073-9844-44a2c9afdc19',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.720063] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.885445] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6ffdfa8-6380-47fd-b801-823581edd625 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.885616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.888837] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6ffdfa8-6380-47fd-b801-823581edd625',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.889724] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d35e4595-6665-4073-9844-44a2c9afdc19 with status ACTIVE [ 786.889905] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.890032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.890178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.890290] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.890374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.890547] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.890638] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.890724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.890877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.890961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.891147] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.891478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.891478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.891478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.891559] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.891590] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d35e4595-6665-4073-9844-44a2c9afdc19 is going to be updated. [ 786.911962] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.912149] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.912227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.912466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.912626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.912815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d35e4595-6665-4073-9844-44a2c9afdc19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.223055] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.223287] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.223287] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.223487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.223815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.223815] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 is going to be updated. [ 787.254603] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.254603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.254603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.254603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.254603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.258530] env[69692]: INFO networking_nsxv3.common.synchronization [req-7a626f17-aee6-4507-bc8c-2739ada41ebf req-a44ad450-32c8-4cf8-8820-3158b144081b tempest-InstanceActionsTestJSON-155023934 tempest-InstanceActionsTestJSON-155023934-project-member] Enqueued Resource ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 with Priority: HIGHEST for action security_group_members [ 787.260022] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 with Priority: HIGHEST for action security_group_members [ 787.260022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.260022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.260022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.260022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.261041] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.261041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.261041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.261041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.261041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.261041] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.263028] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: IN_PROGRESS for 2s [ 787.393498] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6ffdfa8-6380-47fd-b801-823581edd625',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.721053] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-141 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.721364] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-141" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.721364] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-141" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.721581] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-141" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.721909] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.722076] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.722214] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.722446] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.722592] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.722789] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.722917] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 787.723110] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 787.723163] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 787.723276] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.723383] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 787.723552] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 787.741195] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 787.741345] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 787.741480] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 787.741641] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-141" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.742137] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-0d2de048-2cc7-494d-b16f-4e84092d7a53 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.742301] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-0d2de048-2cc7-494d-b16f-4e84092d7a53" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.742449] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-0d2de048-2cc7-494d-b16f-4e84092d7a53" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.742708] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-0d2de048-2cc7-494d-b16f-4e84092d7a53" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.742856] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d2de048-2cc7-494d-b16f-4e84092d7a53',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.764577] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.764697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.764768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.764938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.765036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.765213] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.765307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.765368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.765509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.765584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.765664] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 already deleted. [ 787.765742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.896105] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.896265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.896338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.896544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.896631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.896728] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6ffdfa8-6380-47fd-b801-823581edd625 is going to be created. [ 787.918802] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.918802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.918802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.918969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.919096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.928805] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6ffdfa8-6380-47fd-b801-823581edd625 in Status: UNINITIALIZED for 2s [ 788.245389] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.246074] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.246074] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.246193] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.246310] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.246432] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 0d2de048-2cc7-494d-b16f-4e84092d7a53 not found, creating... [ 788.246693] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.246874] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.246995] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.247266] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.247452] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.247784] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.247961] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.248139] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.248408] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.248559] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.248755] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 0d2de048-2cc7-494d-b16f-4e84092d7a53 is going to be created. [ 788.278515] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.278515] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.278760] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.279050] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.279380] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.280137] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-0d2de048-2cc7-494d-b16f-4e84092d7a53" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.275141] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: SUCCESS [ 789.275141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.275408] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.275460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.275648] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.275760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.275823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.275974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.276069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.276151] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.276237] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.349280] env[69692]: INFO networking_nsxv3.common.synchronization [req-7a626f17-aee6-4507-bc8c-2739ada41ebf req-af7a26c3-b809-4b63-8f69-6e8d7010f6c4 service nova] Enqueued Resource ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 with Priority: HIGHEST for action security_group_rules [ 789.349542] env[69692]: INFO networking_nsxv3.common.synchronization [req-7a626f17-aee6-4507-bc8c-2739ada41ebf req-af7a26c3-b809-4b63-8f69-6e8d7010f6c4 service nova] Enqueued Resource ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 with Priority: HIGHEST for action security_group_members [ 789.349760] env[69692]: INFO networking_nsxv3.common.synchronization [req-7a626f17-aee6-4507-bc8c-2739ada41ebf req-af7a26c3-b809-4b63-8f69-6e8d7010f6c4 service nova] Enqueued Resource ID: 0d2de048-2cc7-494d-b16f-4e84092d7a53 with Priority: HIGHEST for action port [ 789.350255] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 with Priority: HIGHEST for action security_group_rules [ 789.350407] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 with Priority: HIGHEST for action security_group_members [ 789.350519] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d2de048-2cc7-494d-b16f-4e84092d7a53 with Priority: HIGHEST for action port [ 789.350862] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.350990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.351068] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.352115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.352115] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.352302] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.352411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.352477] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.352650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.352809] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.352908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.352973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.353154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.353244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.353335] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.354250] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d2de048-2cc7-494d-b16f-4e84092d7a53 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.354250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d2de048-2cc7-494d-b16f-4e84092d7a53" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.354250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d2de048-2cc7-494d-b16f-4e84092d7a53" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.354406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d2de048-2cc7-494d-b16f-4e84092d7a53" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.354478] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d2de048-2cc7-494d-b16f-4e84092d7a53',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.778061] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.778218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.778289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.778497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.778674] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.779147] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.779223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.779384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.779473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.779563] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.779718] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.779814] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.779877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.780158] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.780328] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.780428] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.780491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.780638] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.780736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.780813] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.780903] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.782858] env[69692]: INFO networking_nsxv3.common.synchronization [req-ffcc7209-59a7-4d68-a36f-6c9550b4f867 req-204c7393-2d7f-43ab-888a-6de2cc6cfea2 tempest-ServersTestBootFromVolume-1974867416 tempest-ServersTestBootFromVolume-1974867416-project-member] Enqueued Resource ID: 7ae9a71f-5c96-43e4-8524-e661508c021c with Priority: HIGHEST for action security_group_members [ 789.783575] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ae9a71f-5c96-43e4-8524-e661508c021c with Priority: HIGHEST for action security_group_members [ 789.783792] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ae9a71f-5c96-43e4-8524-e661508c021c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.783899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.783966] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.784388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.784388] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.784492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.784492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.784599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.784675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.784759] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ae9a71f-5c96-43e4-8524-e661508c021c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.856466] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.857505] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.857679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.857879] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d2de048-2cc7-494d-b16f-4e84092d7a53 with status ACTIVE [ 789.858088] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.858228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.858638] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.858638] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.858806] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.859013] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.859126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.859191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.859369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.859450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.859653] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.859753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.859817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.859972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.860864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.861011] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d2de048-2cc7-494d-b16f-4e84092d7a53 is going to be updated. [ 789.881347] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.881472] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.881562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.881813] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.881974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.882140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d2de048-2cc7-494d-b16f-4e84092d7a53" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.946492] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6ffdfa8-6380-47fd-b801-823581edd625 in Status: SUCCESS [ 789.946492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.946492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.946492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.946492] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.946492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.946742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.946742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.946799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.946894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.946981] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6ffdfa8-6380-47fd-b801-823581edd625',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.071341] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.071534] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-302" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.071679] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-302" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.072144] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-302" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.072428] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.072694] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.072750] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.073052] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.073214] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.073437] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.073535] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.073643] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.073743] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.073848] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.073949] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.074103] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.091754] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.091970] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 790.092130] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.092313] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-302" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.092630] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-37b1d77a-427b-4208-8357-855ccd87b71e taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.092811] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-37b1d77a-427b-4208-8357-855ccd87b71e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.092931] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-37b1d77a-427b-4208-8357-855ccd87b71e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.093299] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-37b1d77a-427b-4208-8357-855ccd87b71e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.093440] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37b1d77a-427b-4208-8357-855ccd87b71e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.284324] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b6cb33c-9436-488b-bac4-02b8d09327a1: rpc.has_security_group_logging(os_id): False [ 790.286670] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.286819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.286891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.287119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.287211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.287398] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.287499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.287585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.288023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.288023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.288023] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ae9a71f-5c96-43e4-8524-e661508c021c already deleted. [ 790.288023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.301360] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.301360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.301360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.301360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.301360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.301561] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.301561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.301687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.301777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.301892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.302052] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.302164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.302224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.302353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.302428] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.302615] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.302876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.302954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.303117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.303187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.303539] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 is going to be updated. [ 790.359370] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.359533] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.359610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.359808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.360063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.363142] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.372754] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: IN_PROGRESS for 2s [ 790.451867] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6ffdfa8-6380-47fd-b801-823581edd625 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.452028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.452103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.452321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.452483] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.452634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.452668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.452789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.452875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.452965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.455578] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6ffdfa8-6380-47fd-b801-823581edd625 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.455578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.455578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.455578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.455578] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.455578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.455578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.455578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.455578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.455578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.455578] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6ffdfa8-6380-47fd-b801-823581edd625',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.599019] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.599019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.599019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.599019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.599019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.599019] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 37b1d77a-427b-4208-8357-855ccd87b71e not found, creating... [ 790.599019] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.599019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.599019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.599019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.599019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.599434] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.600023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.600304] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.602359] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.602359] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.602359] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 37b1d77a-427b-4208-8357-855ccd87b71e is going to be created. [ 790.622323] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.624645] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.624645] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.624645] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.624645] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.624645] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-37b1d77a-427b-4208-8357-855ccd87b71e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.865541] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.865775] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.865883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.866137] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.866235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.866336] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 is going to be created. [ 790.888488] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.888635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.888705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.888934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.889107] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.897966] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 in Status: UNINITIALIZED for 2s [ 790.958065] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6ffdfa8-6380-47fd-b801-823581edd625: rpc.has_security_group_logging(os_id): False [ 790.974769] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.974922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.974992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.975249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.975343] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.975550] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.975648] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.975791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.975858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.975938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.976128] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.976222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.976433] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.976433] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.976534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.976660] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.976747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.976804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.976948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.977038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.977126] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6ffdfa8-6380-47fd-b801-823581edd625 is going to be created. [ 791.036586] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.036731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.036805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.037029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.037209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.046624] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6ffdfa8-6380-47fd-b801-823581edd625 in Status: IN_PROGRESS for 2s [ 791.479584] env[69692]: INFO networking_nsxv3.common.synchronization [req-ffcc7209-59a7-4d68-a36f-6c9550b4f867 req-814f2f66-bd88-4140-abfe-0df4391820ec service nova] Enqueued Resource ID: 7ae9a71f-5c96-43e4-8524-e661508c021c with Priority: HIGHEST for action security_group_rules [ 791.479883] env[69692]: INFO networking_nsxv3.common.synchronization [req-ffcc7209-59a7-4d68-a36f-6c9550b4f867 req-814f2f66-bd88-4140-abfe-0df4391820ec service nova] Enqueued Resource ID: 7ae9a71f-5c96-43e4-8524-e661508c021c with Priority: HIGHEST for action security_group_members [ 791.479927] env[69692]: INFO networking_nsxv3.common.synchronization [req-ffcc7209-59a7-4d68-a36f-6c9550b4f867 req-814f2f66-bd88-4140-abfe-0df4391820ec service nova] Enqueued Resource ID: 37b1d77a-427b-4208-8357-855ccd87b71e with Priority: HIGHEST for action port [ 791.480486] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ae9a71f-5c96-43e4-8524-e661508c021c with Priority: HIGHEST for action security_group_rules [ 791.480597] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ae9a71f-5c96-43e4-8524-e661508c021c with Priority: HIGHEST for action security_group_members [ 791.480825] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b1d77a-427b-4208-8357-855ccd87b71e with Priority: HIGHEST for action port [ 791.481073] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ae9a71f-5c96-43e4-8524-e661508c021c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.481205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.481267] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.481468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.481586] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ae9a71f-5c96-43e4-8524-e661508c021c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.482725] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ae9a71f-5c96-43e4-8524-e661508c021c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.482878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.482983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.483253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.483412] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.483916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.484013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.484175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.484254] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.484350] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ae9a71f-5c96-43e4-8524-e661508c021c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.485151] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-37b1d77a-427b-4208-8357-855ccd87b71e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.485304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37b1d77a-427b-4208-8357-855ccd87b71e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.485304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37b1d77a-427b-4208-8357-855ccd87b71e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.485480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37b1d77a-427b-4208-8357-855ccd87b71e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.485591] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37b1d77a-427b-4208-8357-855ccd87b71e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.987688] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ae9a71f-5c96-43e4-8524-e661508c021c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.988784] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ae9a71f-5c96-43e4-8524-e661508c021c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.988893] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.989064] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37b1d77a-427b-4208-8357-855ccd87b71e with status ACTIVE [ 791.989243] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.989349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.989413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.989622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.989750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.989870] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.989963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.990038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.990197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.990276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.990456] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.990548] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.990610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.991871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.992031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.992135] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37b1d77a-427b-4208-8357-855ccd87b71e is going to be updated. [ 792.012163] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.012310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.012372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.012584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.012715] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.012874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37b1d77a-427b-4208-8357-855ccd87b71e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.048813] env[69692]: INFO networking_nsxv3.common.synchronization [req-f3415e48-183f-4202-94b5-930af2542ce2 req-10939e8b-25ce-4092-a472-bce05185e2ce tempest-ServerActionsTestOtherB-2042336296 tempest-ServerActionsTestOtherB-2042336296-project-member] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 792.049215] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 792.049513] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.049629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.049697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.049969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.050258] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.050369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.051030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.051030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.051030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.051030] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.388469] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: SUCCESS [ 792.388723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.464612] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-199 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.464817] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.469031] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.469501] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.469795] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.469973] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.470109] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.470333] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.470478] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.470686] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.470824] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.470993] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.471070] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.471216] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.471340] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.471483] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.492248] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.492248] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 792.492248] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.492248] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.492248] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-9ac2f6b5-81c2-4101-9785-9586d2643157 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.492248] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-9ac2f6b5-81c2-4101-9785-9586d2643157" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.492248] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-9ac2f6b5-81c2-4101-9785-9586d2643157" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.492248] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-9ac2f6b5-81c2-4101-9785-9586d2643157" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.492248] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ac2f6b5-81c2-4101-9785-9586d2643157',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.494424] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ae9a71f-5c96-43e4-8524-e661508c021c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.552515] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.552688] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.552735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.553271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.553271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.553271] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.553446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.553446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.554015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.554015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.554015] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 already deleted. [ 792.554015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.907718] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 in Status: SUCCESS [ 792.907961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.908255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.908469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.908680] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.908812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.908875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.909043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.909126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.909213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.909303] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.997640] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.997640] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.997640] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.997821] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.997960] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.998129] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 9ac2f6b5-81c2-4101-9785-9586d2643157 not found, creating... [ 792.998760] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.998760] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.998760] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.998932] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.999013] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.999302] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.999454] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.999569] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.999772] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.999907] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.007110] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 9ac2f6b5-81c2-4101-9785-9586d2643157 is going to be created. [ 793.008015] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.008186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.008259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.008433] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.008513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.008601] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ae9a71f-5c96-43e4-8524-e661508c021c is going to be created. [ 793.029591] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.029866] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.030064] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.030430] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.030759] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.035272] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-9ac2f6b5-81c2-4101-9785-9586d2643157" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.037283] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.038321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.038321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.038321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.038321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.049292] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ae9a71f-5c96-43e4-8524-e661508c021c in Status: UNINITIALIZED for 2s [ 793.060585] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6ffdfa8-6380-47fd-b801-823581edd625 in Status: SUCCESS [ 793.060821] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.414064] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.414626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.414626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.414626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.415010] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.415010] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.416072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.416072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.416072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.416072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.416072] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.416072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.416072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.416497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.416497] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.416596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.416719] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.416859] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.416974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.417827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.417961] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.744910] env[69692]: INFO networking_nsxv3.common.synchronization [req-f3415e48-183f-4202-94b5-930af2542ce2 req-0104414f-5076-4aed-a95c-a7d6b78ecdd8 service nova] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_rules [ 793.744910] env[69692]: INFO networking_nsxv3.common.synchronization [req-f3415e48-183f-4202-94b5-930af2542ce2 req-0104414f-5076-4aed-a95c-a7d6b78ecdd8 service nova] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 793.744910] env[69692]: INFO networking_nsxv3.common.synchronization [req-f3415e48-183f-4202-94b5-930af2542ce2 req-0104414f-5076-4aed-a95c-a7d6b78ecdd8 service nova] Enqueued Resource ID: 9ac2f6b5-81c2-4101-9785-9586d2643157 with Priority: HIGHEST for action port [ 793.745283] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_rules [ 793.745283] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 793.745373] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac2f6b5-81c2-4101-9785-9586d2643157 with Priority: HIGHEST for action port [ 793.745867] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.746258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.746258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.746427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.746665] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.747730] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.747730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.747730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.747730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.747908] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.747908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.747990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.752289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.752289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.752289] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.752745] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ac2f6b5-81c2-4101-9785-9586d2643157 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.752875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ac2f6b5-81c2-4101-9785-9586d2643157" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.752929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ac2f6b5-81c2-4101-9785-9586d2643157" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.753124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ac2f6b5-81c2-4101-9785-9586d2643157" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.753241] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ac2f6b5-81c2-4101-9785-9586d2643157',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.921233] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1: rpc.has_security_group_logging(os_id): False [ 793.938406] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.938570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.938661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.938918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.939021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.939237] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.939357] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.939418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.939604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.939681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.939933] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.940066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.940128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.940297] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.940371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.940590] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.940700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.940793] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.940946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.941195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.942026] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 is going to be created. [ 793.999366] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.999490] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.999582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.999771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.999952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.014381] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 in Status: IN_PROGRESS for 2s [ 794.254981] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.255187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.255379] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.256341] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ac2f6b5-81c2-4101-9785-9586d2643157 with status ACTIVE [ 794.257731] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.257731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.257731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.257731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.257731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.257731] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.257731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.257731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.257731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.257731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.257731] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.258369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.258369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.258369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.258369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.258369] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ac2f6b5-81c2-4101-9785-9586d2643157 is going to be updated. [ 794.279361] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.279361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.279361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.279361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.279361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.279544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ac2f6b5-81c2-4101-9785-9586d2643157" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.761404] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.795214] env[69692]: INFO networking_nsxv3.common.synchronization [req-367abc6a-d0ee-4b8e-b5fa-48413a2c6aef req-896f2c82-f541-4803-81c2-1420027b09ac tempest-MigrationsAdminTest-1006177328 tempest-MigrationsAdminTest-1006177328-project-member] Enqueued Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_members [ 794.795675] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_members [ 794.795959] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.796097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.796161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.796392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.796490] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.796580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.796637] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.796769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.797327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.799381] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.856378] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.856738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.857606] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.857852] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.857963] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.059262] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ae9a71f-5c96-43e4-8524-e661508c021c in Status: SUCCESS [ 795.059672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.060922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.061131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.061329] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.061445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.061510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.061691] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.061799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.063668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.063668] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ae9a71f-5c96-43e4-8524-e661508c021c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.267805] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.267805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.267805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.267805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.267805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.267805] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be created. [ 795.291009] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.291188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.291264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.293679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.293679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.300947] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: UNINITIALIZED for 2s [ 795.302082] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.312022] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.312022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.312022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.312022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.312587] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.319023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.319023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.319023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.319023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.319023] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.319023] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 795.319023] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 795.319023] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 795.319023] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.319023] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 795.319023] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 795.336850] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 795.336850] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 795.337174] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 795.337174] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-420" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.337475] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-22eb6a48-cca1-4e06-9589-c53d711a4b08 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.337656] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-22eb6a48-cca1-4e06-9589-c53d711a4b08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.337797] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-22eb6a48-cca1-4e06-9589-c53d711a4b08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.338137] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-22eb6a48-cca1-4e06-9589-c53d711a4b08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.338284] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22eb6a48-cca1-4e06-9589-c53d711a4b08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.363727] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.568159] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ae9a71f-5c96-43e4-8524-e661508c021c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.805870] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.842177] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.842427] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.842479] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.842774] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.842926] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.843117] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 22eb6a48-cca1-4e06-9589-c53d711a4b08 not found, creating... [ 795.843398] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.843591] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.843675] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.843905] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.844923] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.844923] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.844923] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.844923] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.844923] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.844923] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.845237] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 22eb6a48-cca1-4e06-9589-c53d711a4b08 is going to be created. [ 795.869270] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.869497] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.869724] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.869909] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.870157] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.870390] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-22eb6a48-cca1-4e06-9589-c53d711a4b08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.871682] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.034994] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 in Status: SUCCESS [ 796.035299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.074508] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ae9a71f-5c96-43e4-8524-e661508c021c: rpc.has_security_group_logging(os_id): False [ 796.092775] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.092932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.093010] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.093257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.093351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.093621] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.093745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.093812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.093971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.094077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.094173] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ae9a71f-5c96-43e4-8524-e661508c021c is going to be created. [ 796.171817] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.171987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.172044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.176382] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.176591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.186588] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ae9a71f-5c96-43e4-8524-e661508c021c in Status: IN_PROGRESS for 2s [ 796.308428] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.308611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.308787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.308923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.309031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.309567] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803064c7-17f8-46ee-bdf3-20357514c794 is going to be updated. [ 796.338272] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.338487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.338487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.338711] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.338855] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.353289] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: IN_PROGRESS for 2s [ 796.377402] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 796.377549] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 797.122275] env[69692]: INFO networking_nsxv3.common.synchronization [req-367abc6a-d0ee-4b8e-b5fa-48413a2c6aef req-8bee9600-e396-4e95-aba8-6f836c920a87 service nova] Enqueued Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_rules [ 797.122553] env[69692]: INFO networking_nsxv3.common.synchronization [req-367abc6a-d0ee-4b8e-b5fa-48413a2c6aef req-8bee9600-e396-4e95-aba8-6f836c920a87 service nova] Enqueued Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_members [ 797.122553] env[69692]: INFO networking_nsxv3.common.synchronization [req-367abc6a-d0ee-4b8e-b5fa-48413a2c6aef req-8bee9600-e396-4e95-aba8-6f836c920a87 service nova] Enqueued Resource ID: 22eb6a48-cca1-4e06-9589-c53d711a4b08 with Priority: HIGHEST for action port [ 797.123018] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_rules [ 797.123205] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_members [ 797.123307] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22eb6a48-cca1-4e06-9589-c53d711a4b08 with Priority: HIGHEST for action port [ 797.123693] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.123828] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.123889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.124097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.124180] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.125351] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.125484] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.125628] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-22eb6a48-cca1-4e06-9589-c53d711a4b08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.125722] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22eb6a48-cca1-4e06-9589-c53d711a4b08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.125782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22eb6a48-cca1-4e06-9589-c53d711a4b08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.125988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22eb6a48-cca1-4e06-9589-c53d711a4b08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.126080] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22eb6a48-cca1-4e06-9589-c53d711a4b08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.151303] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.151505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.151505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.151718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.162984] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 797.167015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.167015] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 797.190461] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.190461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.190461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.190695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.198361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.198361] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 797.198361] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.198361] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 797.259467] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.259628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.259664] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.259907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.261215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.261392] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 797.313600] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: SUCCESS [ 797.313738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.313902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.314154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.314367] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.314517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.314517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.314696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.314729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.314815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.314944] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.355517] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.355517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.355517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.355517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.355517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.355839] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 797.429720] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.429878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.429942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.430162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.430370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.430657] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 797.430716] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b8df4df4-eeff-413c-833f-3852b9a4a49a', '8762fd5f-5739-422a-86bf-68d91e441823', 'bcf8de7e-6145-413a-bbc2-af3db93cdf58', '3d4ca52d-d178-4c04-a293-073162c8fb0b', '0606438c-ea63-4fae-97b5-53d1cd997a59', '7d9ea5c0-4781-4575-9fde-6a93632303e0', '532815ef-03c8-40fb-91ab-292fc1c769b2', '7ef05655-0d1f-4345-946e-e5a87b85a408', 'aade30ad-1e65-411f-be2a-2831f287cfbc', '92949372-ad62-4c3b-ab83-73cb755bd4de', 'bcbeb6f9-c515-4ff5-9c1f-1b944526d767', 'b6ffdfa8-6380-47fd-b801-823581edd625', 'a18ef3ce-d814-4cfb-b497-dbf659cd1988', '501c3651-4f53-4420-b2dc-d80ff25930b1', 'ba349899-fefa-463c-b088-f091f368c717', '66714054-d28c-49d2-8bed-8ed704c74fc1', 'beac83ef-5694-434f-9cdc-fd976212be41', '40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1', '803064c7-17f8-46ee-bdf3-20357514c794', '3be1563c-4654-47e8-ad88-88687976498b', 'b57d8773-fb88-48dd-8778-aad060b75558', 'f4dd1b93-af3a-481d-8833-92383b938f1f', 'b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2', '7ae9a71f-5c96-43e4-8524-e661508c021c', 'f5345cc2-0f25-4dd2-bed5-a938bfc6e247', '559d2715-9b43-4a1c-ab57-3faf644a7a85', 'cb8b39ac-23d5-452c-9ec6-33c3aa98d53f', '859b640d-3815-457c-8a5b-e9eee00dbcee', 'a8524b03-3553-4474-98ff-53fee924a364', '0b6cb33c-9436-488b-bac4-02b8d09327a1', 'ebdff0ac-e383-4307-98b2-c7e34194e641', 'c3f4ecb4-733b-4e4f-a088-b50706c8f083', '3c88a973-e953-4cb7-bda1-829fc68b91a4', 'ab04df45-cf74-4894-8e09-dc03e4e3ecab', '1eb8f10e-5f89-461b-a5a7-acb98b29cbbb'} {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.430927] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 797.451540] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.451693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.451693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.453970] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.453970] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.453970] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 797.453970] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.453970] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 797.513469] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.513469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.513677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.514072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.515474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.515899] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 797.515899] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 797.515899] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 797.516052] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 797.516145] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 797.516244] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGH for action security_group_rules [ 797.516348] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8762fd5f-5739-422a-86bf-68d91e441823 with Priority: HIGH for action security_group_rules [ 797.516437] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGH for action security_group_rules [ 797.516523] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGH for action security_group_rules [ 797.516606] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGH for action security_group_rules [ 797.516690] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGH for action security_group_rules [ 797.516773] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGH for action security_group_rules [ 797.516857] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 with Priority: HIGH for action security_group_rules [ 797.516941] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGH for action security_group_rules [ 797.517037] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGH for action security_group_rules [ 797.517127] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGH for action security_group_rules [ 797.517206] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6ffdfa8-6380-47fd-b801-823581edd625 with Priority: HIGH for action security_group_rules [ 797.517289] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 with Priority: HIGH for action security_group_rules [ 797.517374] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGH for action security_group_rules [ 797.517686] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba349899-fefa-463c-b088-f091f368c717 with Priority: HIGH for action security_group_rules [ 797.517841] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGH for action security_group_rules [ 797.517950] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: beac83ef-5694-434f-9cdc-fd976212be41 with Priority: HIGH for action security_group_rules [ 797.518064] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 with Priority: HIGH for action security_group_rules [ 797.518158] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGH for action security_group_rules [ 797.518645] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3be1563c-4654-47e8-ad88-88687976498b with Priority: HIGH for action security_group_rules [ 797.519115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.628518] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.628712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.631391] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22eb6a48-cca1-4e06-9589-c53d711a4b08 with status ACTIVE [ 797.631593] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.631713] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.631772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.631977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.632070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.632353] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.632353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.632813] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.632813] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.632813] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.632813] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.632954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.632954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.633348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.633348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.633348] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22eb6a48-cca1-4e06-9589-c53d711a4b08 is going to be updated. [ 797.653286] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.653421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.653497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.653662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.653792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.653942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22eb6a48-cca1-4e06-9589-c53d711a4b08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.817584] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.206115] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ae9a71f-5c96-43e4-8524-e661508c021c in Status: SUCCESS [ 798.206115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.248371] env[69692]: INFO networking_nsxv3.common.synchronization [req-177e27f3-a047-4aba-94d5-04b7ce5db05c req-8527226d-af20-4f0c-8d5f-9242717e6dca tempest-ServerDiskConfigTestJSON-756528476 tempest-ServerDiskConfigTestJSON-756528476-project-member] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 798.248911] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 798.249097] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGH for action security_group_rules [ 798.249256] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGH for action security_group_rules [ 798.249294] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGH for action security_group_rules [ 798.249396] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba349899-fefa-463c-b088-f091f368c717 with Priority: HIGH for action security_group_rules [ 798.249724] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be1563c-4654-47e8-ad88-88687976498b with Priority: HIGH for action security_group_rules [ 798.249862] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGH for action security_group_rules [ 798.249981] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 with Priority: HIGH for action security_group_rules [ 798.250117] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beac83ef-5694-434f-9cdc-fd976212be41 with Priority: HIGH for action security_group_rules [ 798.250241] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGH for action security_group_rules [ 798.250357] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGH for action security_group_rules [ 798.250471] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 with Priority: HIGH for action security_group_rules [ 798.250586] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6ffdfa8-6380-47fd-b801-823581edd625 with Priority: HIGH for action security_group_rules [ 798.250885] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGH for action security_group_rules [ 798.251048] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGH for action security_group_rules [ 798.251198] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGH for action security_group_rules [ 798.251347] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 with Priority: HIGH for action security_group_rules [ 798.251404] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 with Priority: HIGH for action security_group_rules [ 798.251497] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGH for action security_group_rules [ 798.251622] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8762fd5f-5739-422a-86bf-68d91e441823 with Priority: HIGH for action security_group_rules [ 798.251771] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b with Priority: HIGH for action security_group_rules [ 798.252106] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.252273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.252354] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.252579] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.252766] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.252900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.252982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.253251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.253311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.253388] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.254355] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8df4df4-eeff-413c-833f-3852b9a4a49a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.257965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.257965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.257965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.257965] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.257965] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.257965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.257965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.257965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.257965] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.257965] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.257965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.257965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.257965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.257965] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.258604] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba349899-fefa-463c-b088-f091f368c717 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.258604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.258604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.258746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.258746] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba349899-fefa-463c-b088-f091f368c717',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.260450] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3be1563c-4654-47e8-ad88-88687976498b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.260554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.260618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.262053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.262053] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3be1563c-4654-47e8-ad88-88687976498b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.262212] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.262569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.262569] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.262703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.262703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.262907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.262972] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.263858] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-beac83ef-5694-434f-9cdc-fd976212be41 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.263998] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.264185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.264356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.264479] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('beac83ef-5694-434f-9cdc-fd976212be41',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.265363] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-501c3651-4f53-4420-b2dc-d80ff25930b1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.265497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.265580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.265753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.265844] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.266723] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.266859] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.266944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.267159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.267260] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.267648] env[69692]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 798.268324] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a18ef3ce-d814-4cfb-b497-dbf659cd1988 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.268459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.268541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.268727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.268825] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a18ef3ce-d814-4cfb-b497-dbf659cd1988',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.269702] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6ffdfa8-6380-47fd-b801-823581edd625 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.269822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.269875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.270205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.270304] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6ffdfa8-6380-47fd-b801-823581edd625',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.271652] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.271808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.271909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.272093] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.272197] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.273030] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.273187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.273310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.273476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.273546] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.274349] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.274458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.274505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.274648] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.274712] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.275549] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d9ea5c0-4781-4575-9fde-6a93632303e0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.275677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.275767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.275926] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.276037] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d9ea5c0-4781-4575-9fde-6a93632303e0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.276992] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ef05655-0d1f-4345-946e-e5a87b85a408 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.278126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.278242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.278592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.278592] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ef05655-0d1f-4345-946e-e5a87b85a408',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.279400] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0606438c-ea63-4fae-97b5-53d1cd997a59 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.279544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.279632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.280221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.280221] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.280901] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8762fd5f-5739-422a-86bf-68d91e441823 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.281144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.281248] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.281425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.281523] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8762fd5f-5739-422a-86bf-68d91e441823',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.282451] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d4ca52d-d178-4c04-a293-073162c8fb0b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.282596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.282685] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.282858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.282970] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d4ca52d-d178-4c04-a293-073162c8fb0b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.283232] env[69692]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 798.290754] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8df4df4-eeff-413c-833f-3852b9a4a49a taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.290959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.290959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.291304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.291492] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.294038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.294038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.294038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.294038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.294038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.294038] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.324496] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d450c5a-e2df-45be-a358-d8fce8ee7d24: rpc.has_security_group_logging(os_id): False [ 798.346420] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.346539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.346539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.346741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.347050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.347174] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.347174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.347272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.347422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.347478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.347546] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be created. [ 798.363886] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: SUCCESS [ 798.364370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.365294] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.365525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.366641] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.366641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.366641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.366641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.366641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.366641] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.407359] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.407499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.407816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.407900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.408096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.423441] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: IN_PROGRESS for 2s [ 798.786292] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.786292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.786292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.786292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.799595] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.807019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.807019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.807585] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.807983] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.808273] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.808769] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.809244] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.809618] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.809901] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.810282] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.810583] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.810923] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.811170] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.811472] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.811704] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.812486] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.812737] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.813280] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.815906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.816448] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.820034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.820034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.820034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.820034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.820034] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 798.820034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.820034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.825321] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.825704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.825905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.826222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.826564] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.826806] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.826952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.827198] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.827393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.827577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.827771] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.832023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.832023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.832023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.832023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.832023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.832023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.832023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.832023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.832023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.832023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.832023] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.832023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0606438c-ea63-4fae-97b5-53d1cd997a59 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.832023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.832023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.832023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.832023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.832863] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.833938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.834472] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.834642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.834854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.835112] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.843728] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6ffdfa8-6380-47fd-b801-823581edd625 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.843925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.844269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.844269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.844597] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.844685] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.844761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.844973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.845024] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.845162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.845330] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6ffdfa8-6380-47fd-b801-823581edd625',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.847579] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.849351] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.849531] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.849898] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.851032] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-a9018ab2-df45-4bc6-8f2e-d174d47b9c88 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.851032] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-a9018ab2-df45-4bc6-8f2e-d174d47b9c88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.851032] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-a9018ab2-df45-4bc6-8f2e-d174d47b9c88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.851032] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-a9018ab2-df45-4bc6-8f2e-d174d47b9c88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.851328] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9018ab2-df45-4bc6-8f2e-d174d47b9c88',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.861053] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.861247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.861311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.861466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.861625] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.861717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.861819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.861927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.862127] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.862127] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.862277] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.863093] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.863218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.863308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.863412] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.863556] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.864065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.864181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.864337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.864418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.866503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.866503] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.866503] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-501c3651-4f53-4420-b2dc-d80ff25930b1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.866503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.866503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.866503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.866503] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.866503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.866503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.866503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.866503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.867090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.867192] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.882239] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.882394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.882394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.884029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.884029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.884832] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.915797] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.916724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.917337] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.917943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.926021] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 798.928400] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.928400] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.934771] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.934929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.937612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.937752] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 is going to be deleted. [ 798.939241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.939455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.941357] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.941454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.942335] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.942464] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.943334] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.943424] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.944159] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.944255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.945030] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.945132] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.946494] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.946588] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.975258] env[69692]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 798.975766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.975894] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8762fd5f-5739-422a-86bf-68d91e441823 is going to be deleted. [ 798.976833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.977062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.003670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.003827] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a18ef3ce-d814-4cfb-b497-dbf659cd1988 is going to be deleted. [ 799.004660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.004886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.089879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.090040] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3be1563c-4654-47e8-ad88-88687976498b is going to be deleted. [ 799.091142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.091428] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.112183] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.112183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.112183] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.112355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.117634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.119265] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba349899-fefa-463c-b088-f091f368c717 is going to be deleted. [ 799.120216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.120752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.158803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.158961] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ef05655-0d1f-4345-946e-e5a87b85a408 is going to be deleted. [ 799.159872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.160710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.166451] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.166451] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.167011] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.167109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.191210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.191361] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be deleted. [ 799.192790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.193015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.194823] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.194930] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.263551] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.263824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.279038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.279518] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d9ea5c0-4781-4575-9fde-6a93632303e0 is going to be deleted. [ 799.280479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.280696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.301692] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8df4df4-eeff-413c-833f-3852b9a4a49a: rpc.has_security_group_logging(os_id): False [ 799.316267] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.316396] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: beac83ef-5694-434f-9cdc-fd976212be41 is going to be deleted. [ 799.317678] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.318174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.318328] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.318465] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be deleted. [ 799.320347] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.321520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.337259] env[69692]: INFO networking_nsxv3.common.synchronization [req-94936989-6cce-4094-ba36-eb5860bd733a req-6d1ac556-8fa8-4680-bf05-b56548d6d4c2 tempest-VolumesAdminNegativeTest-1078272547 tempest-VolumesAdminNegativeTest-1078272547-project-member] Enqueued Resource ID: b6ffdfa8-6380-47fd-b801-823581edd625 with Priority: HIGHEST for action security_group_members [ 799.338676] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.338676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.338834] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6ffdfa8-6380-47fd-b801-823581edd625 with Priority: HIGHEST for action security_group_members [ 799.339844] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6ffdfa8-6380-47fd-b801-823581edd625 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.339975] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.340258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.340529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.340630] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.340728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.340825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.340953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.341049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.341143] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6ffdfa8-6380-47fd-b801-823581edd625',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.345750] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.345750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.353304] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.357111] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.360277] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.360277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.360277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.360537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.360619] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.360723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.360810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.360948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.361043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.361131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.361840] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.361840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.361840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.361840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.361840] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.361840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.361840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.362139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.362139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.362199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.362254] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.376578] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6ffdfa8-6380-47fd-b801-823581edd625 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.376729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.379823] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.379823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.379823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.379823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.379823] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.379823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.379823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.379823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.379823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.379823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.379823] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.379823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.379823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.379823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.379823] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.379823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.380458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.380458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.380458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.380458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.380458] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.381668] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.381926] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.382111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.382350] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.382525] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.383593] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port a9018ab2-df45-4bc6-8f2e-d174d47b9c88 not found, creating... [ 799.383593] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.383593] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.383593] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.383593] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.383812] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.383960] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.384385] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.384385] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.384385] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.384514] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.384651] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: a9018ab2-df45-4bc6-8f2e-d174d47b9c88 is going to be created. [ 799.385703] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.387382] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.388176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.388176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.388176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.388176] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.388176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.388176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.388586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.388586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.388586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.388743] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.388743] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.388829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.388929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.389081] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.389174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.389234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.389372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.389447] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.389526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.389607] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.390480] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.400841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.400990] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d4ca52d-d178-4c04-a293-073162c8fb0b is going to be deleted. [ 799.401836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.402042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.402132] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.402305] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.404121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.404297] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.404382] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.404493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8762fd5f-5739-422a-86bf-68d91e441823" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.404960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.405145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.405231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.405352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3be1563c-4654-47e8-ad88-88687976498b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.405701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.406030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.406118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.406228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a18ef3ce-d814-4cfb-b497-dbf659cd1988" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.406358] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.406500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.406659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.406784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba349899-fefa-463c-b088-f091f368c717" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.406784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.406961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.407046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.407151] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ef05655-0d1f-4345-946e-e5a87b85a408" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.407543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.407723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.450290] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.450581] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.450751] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.451083] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.451364] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.451610] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-a9018ab2-df45-4bc6-8f2e-d174d47b9c88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.453672] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.453812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.455527] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.455982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.458925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.460020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.460191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.460253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.460531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.460668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.460842] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8df4df4-eeff-413c-833f-3852b9a4a49a is going to be updated. [ 799.461940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.462336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.462448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.462536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.463079] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.463386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.463891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.464469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d9ea5c0-4781-4575-9fde-6a93632303e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.464469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.464682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.464728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.464819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.512627] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.512830] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.512889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.513162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.513258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.513380] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-beac83ef-5694-434f-9cdc-fd976212be41" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.565318] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.565499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.565631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.565815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.565913] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.566046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d4ca52d-d178-4c04-a293-073162c8fb0b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.644961] env[69692]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 799.644961] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.644961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.644961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.644961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.644961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.676505] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8df4df4-eeff-413c-833f-3852b9a4a49a in Status: IN_PROGRESS for 2s [ 799.715839] env[69692]: INFO networking_nsxv3.common.synchronization [None req-728dac9e-7715-4ddb-a192-9a720fd813e3 None None] Enqueued Resource ID: abafb135-53bd-46ea-a836-243195ff4d61 with Priority: HIGHEST for action port [ 799.716570] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abafb135-53bd-46ea-a836-243195ff4d61 with Priority: HIGHEST for action port [ 799.716938] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-abafb135-53bd-46ea-a836-243195ff4d61 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.717104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abafb135-53bd-46ea-a836-243195ff4d61" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.717196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abafb135-53bd-46ea-a836-243195ff4d61" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.717491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abafb135-53bd-46ea-a836-243195ff4d61" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.717597] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abafb135-53bd-46ea-a836-243195ff4d61',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.846730] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.846730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.846730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.846730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.857481] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0606438c-ea63-4fae-97b5-53d1cd997a59: rpc.has_security_group_logging(os_id): False [ 799.858951] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66714054-d28c-49d2-8bed-8ed704c74fc1: rpc.has_security_group_logging(os_id): False [ 799.864728] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92949372-ad62-4c3b-ab83-73cb755bd4de: rpc.has_security_group_logging(os_id): False [ 799.877023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.877023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.877023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.877023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.878083] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.879286] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.882022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.882022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.882022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.882022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.882022] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6ffdfa8-6380-47fd-b801-823581edd625 is going to be updated. [ 799.882022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.882022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.883576] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.884108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.887308] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1: rpc.has_security_group_logging(os_id): False [ 799.892028] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 501c3651-4f53-4420-b2dc-d80ff25930b1: rpc.has_security_group_logging(os_id): False [ 799.895909] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.896304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.896505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.899017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.899017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.899017] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803064c7-17f8-46ee-bdf3-20357514c794 is going to be updated. [ 799.899017] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aade30ad-1e65-411f-be2a-2831f287cfbc: rpc.has_security_group_logging(os_id): False [ 799.908790] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.909272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.910490] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.911089] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.911823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.911823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.911823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.911823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.911823] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 is going to be updated. [ 799.913423] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.913715] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.915416] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.918985] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.918985] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.918985] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.918985] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.918985] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.918985] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.918985] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.918985] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.928970] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6ffdfa8-6380-47fd-b801-823581edd625 in Status: IN_PROGRESS for 2s [ 799.934899] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.934899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.934899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.934899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.934899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.936458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.938955] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.938955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.938955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.938955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.938955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.938955] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 is going to be updated. [ 799.938955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.938955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.941828] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: IN_PROGRESS for 2s [ 799.961170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.961170] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.961170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.961170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.961170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.961170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.961170] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 is going to be updated. [ 799.961170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.961170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.987956] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.987956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.991267] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.992509] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.992509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.992509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.992509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.992509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.992509] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.992509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.992509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.993049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.993049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.993049] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.993049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.993049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.993270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.993270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.993372] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 799.997787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.997787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.024313] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.024478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.046775] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.046775] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.047635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.047941] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.048112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.048154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.048350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.048421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.048622] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.048710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.048775] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.048927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.049015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.049262] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.049345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.049409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.049611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.049611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.049695] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92949372-ad62-4c3b-ab83-73cb755bd4de is going to be updated. [ 800.050701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.050948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.051095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.052219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.052386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.092019] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 in Status: IN_PROGRESS for 2s [ 800.103631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.104271] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.104271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.104271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.104271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.104440] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.104560] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.104664] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.104728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.104873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.104948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.105156] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.105236] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.105295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.105438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.105512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.105601] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 is going to be updated. [ 800.108162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.108338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.108479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.109427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.109593] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.109724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.111473] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.111593] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.111728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.111827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.111986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.141995] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 in Status: IN_PROGRESS for 2s [ 800.144228] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: IN_PROGRESS for 2s [ 800.157289] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 800.190373] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.190561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.190650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.192811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.192811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.223187] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abafb135-53bd-46ea-a836-243195ff4d61 [ 800.223187] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.223187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.223187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.223187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.223187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.223187] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abafb135-53bd-46ea-a836-243195ff4d61 already deleted. [ 800.223187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abafb135-53bd-46ea-a836-243195ff4d61" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.248176] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: IN_PROGRESS for 2s [ 800.273199] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.273579] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.273579] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.273676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.273817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.299564] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 in Status: IN_PROGRESS for 2s [ 800.346148] env[69692]: INFO networking_nsxv3.common.synchronization [req-177e27f3-a047-4aba-94d5-04b7ce5db05c req-9d6906d8-ad28-46f6-b85f-64dc2fa48acd service nova] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_rules [ 800.346386] env[69692]: INFO networking_nsxv3.common.synchronization [req-177e27f3-a047-4aba-94d5-04b7ce5db05c req-9d6906d8-ad28-46f6-b85f-64dc2fa48acd service nova] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 800.346566] env[69692]: INFO networking_nsxv3.common.synchronization [req-177e27f3-a047-4aba-94d5-04b7ce5db05c req-9d6906d8-ad28-46f6-b85f-64dc2fa48acd service nova] Enqueued Resource ID: a9018ab2-df45-4bc6-8f2e-d174d47b9c88 with Priority: HIGHEST for action port [ 800.350019] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_rules [ 800.350019] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 800.350019] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9018ab2-df45-4bc6-8f2e-d174d47b9c88 with Priority: HIGHEST for action port [ 800.350019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.350019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.350019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.350019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.350019] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.352222] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.352222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.352222] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9018ab2-df45-4bc6-8f2e-d174d47b9c88 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.352222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9018ab2-df45-4bc6-8f2e-d174d47b9c88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.352222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9018ab2-df45-4bc6-8f2e-d174d47b9c88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.352222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9018ab2-df45-4bc6-8f2e-d174d47b9c88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.352222] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9018ab2-df45-4bc6-8f2e-d174d47b9c88',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.434170] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: SUCCESS [ 800.434967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.852331] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.852331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.855474] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9018ab2-df45-4bc6-8f2e-d174d47b9c88 with status ACTIVE [ 800.855725] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.855859] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.860870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.860870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.860870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.860870] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.860870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.860870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.860870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.860870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.860870] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.860870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.860870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.860870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.860870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.860870] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9018ab2-df45-4bc6-8f2e-d174d47b9c88 is going to be updated. [ 800.878382] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.878485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.878738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.878767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.880030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.880030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9018ab2-df45-4bc6-8f2e-d174d47b9c88" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.937541] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 800.937541] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 deletion is rescheduled due to dependency. [ 800.937541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.937541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.937541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.937541] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.937541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.937541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.937541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.938091] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.938091] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.063479] env[69692]: INFO networking_nsxv3.common.synchronization [req-addd1941-7113-44e7-92c1-b6ad314ffd11 req-6256a558-e835-40bb-848a-f847876383f4 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 801.064101] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 801.064508] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.064586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.064622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.064808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.064957] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.065066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.065125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.065344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.065429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.065521] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.105521] env[69692]: INFO networking_nsxv3.common.synchronization [req-bf9d5681-4780-40ef-aa41-0e1fddb2c115 req-5c94466f-906f-49cb-a776-75e9e100902f tempest-ServersAdminNegativeTestJSON-1244089969 tempest-ServersAdminNegativeTestJSON-1244089969-project-member] Enqueued Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_members [ 801.106748] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGHEST for action security_group_members [ 801.108460] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.108460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.108460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.108460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.108460] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.108460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.108460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.108460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.108460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.108460] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.441092] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.523519] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.523710] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-207" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.523833] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-207" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.524143] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-207" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.527040] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.527148] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.528038] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.528038] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.528038] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.528038] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.528038] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.528230] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.528230] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.528340] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.528587] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.528587] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.553022] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.553993] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.553993] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.553993] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-207" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.554548] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-48799df7-5d7b-414b-bd2b-a318c43afd3e taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.554817] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.555114] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.555664] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.555664] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48799df7-5d7b-414b-bd2b-a318c43afd3e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.568571] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.617843] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.617843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.617843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.617843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.617843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.617843] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.617843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.617843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.617843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.617843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.617843] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92949372-ad62-4c3b-ab83-73cb755bd4de is going to be updated. [ 801.643511] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.643706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.643777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.643986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.644155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.655716] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: IN_PROGRESS for 2s [ 801.689380] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8df4df4-eeff-413c-833f-3852b9a4a49a in Status: SUCCESS [ 801.689633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.734229] env[69692]: INFO networking_nsxv3.common.synchronization [None req-5ef2cc24-96df-4435-9fca-8c3eecb3c998 None None] Enqueued Resource ID: 5e98d229-22aa-4777-8b33-0234b65b5e29 with Priority: HIGHEST for action port [ 801.734677] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e98d229-22aa-4777-8b33-0234b65b5e29 with Priority: HIGHEST for action port [ 801.735017] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e98d229-22aa-4777-8b33-0234b65b5e29 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.735140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e98d229-22aa-4777-8b33-0234b65b5e29" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.735861] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e98d229-22aa-4777-8b33-0234b65b5e29" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.735861] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e98d229-22aa-4777-8b33-0234b65b5e29" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.735861] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e98d229-22aa-4777-8b33-0234b65b5e29',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.939735] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6ffdfa8-6380-47fd-b801-823581edd625 in Status: SUCCESS [ 801.939735] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6ffdfa8-6380-47fd-b801-823581edd625 deletion is rescheduled due to dependency. [ 801.939735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.939735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.939735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.940033] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.940116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.940656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.940656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.940656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.940909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.940909] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6ffdfa8-6380-47fd-b801-823581edd625 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.941122] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.941122] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.941345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.941549] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.941679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.942489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.942489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.942489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.942489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.942489] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6ffdfa8-6380-47fd-b801-823581edd625',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.944648] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.952949] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: SUCCESS [ 801.953191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.953364] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.953569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.953861] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.954123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.954170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.954373] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.954468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.954560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.954896] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.059016] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.059271] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.059404] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.059678] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.059814] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.059974] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 48799df7-5d7b-414b-bd2b-a318c43afd3e not found, creating... [ 802.060285] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.060447] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.060568] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.060843] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.060947] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.061256] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.061415] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.061533] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.061880] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.061880] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.062036] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 48799df7-5d7b-414b-bd2b-a318c43afd3e is going to be created. [ 802.070725] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.079958] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.080193] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.080322] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.080596] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.080849] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.083814] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.107398] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 in Status: SUCCESS [ 802.107615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.159658] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: SUCCESS [ 802.159939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.160885] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 in Status: SUCCESS [ 802.161157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.180408] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 802.180614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.239433] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e98d229-22aa-4777-8b33-0234b65b5e29 [ 802.239863] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.239863] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.239863] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.240113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.240205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.240303] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e98d229-22aa-4777-8b33-0234b65b5e29 already deleted. [ 802.240386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e98d229-22aa-4777-8b33-0234b65b5e29" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.269214] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: SUCCESS [ 802.269437] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.321324] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 in Status: SUCCESS [ 802.321549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.448157] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6ffdfa8-6380-47fd-b801-823581edd625: rpc.has_security_group_logging(os_id): False [ 802.448513] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.448579] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.448617] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.448828] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.448916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.449444] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 802.458645] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.458645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.458645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.458645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.458645] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.458645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.459202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.459202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.459202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.459202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.459202] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.459348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.459348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.459432] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.459569] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.459660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.459717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.459849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.459924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.460015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.460102] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.467103] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.467284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.467395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.467648] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.467799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.468219] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.468281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.468313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.468507] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.468605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.468864] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.469034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.471796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.471796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.471796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.471796] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.471796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.471796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.471796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.471796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.471796] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6ffdfa8-6380-47fd-b801-823581edd625 is going to be updated. [ 802.485036] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.485036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.485036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.485036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.485036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.493062] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 802.533962] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.534161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.534210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.534394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.534539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.556658] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6ffdfa8-6380-47fd-b801-823581edd625 in Status: IN_PROGRESS for 2s [ 802.575025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.575025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.575025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.575025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.575025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.575025] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 802.613881] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.614052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.614095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.614346] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.614501] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.624497] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 802.973557] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 803064c7-17f8-46ee-bdf3-20357514c794: rpc.has_security_group_logging(os_id): False [ 802.989535] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.989535] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.989535] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.989535] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.005835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.006122] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.006218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.006283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.006480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.006562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.006835] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.006949] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.007027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.007183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.007260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.007451] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.007545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.007609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.007746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.007820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.007942] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 803064c7-17f8-46ee-bdf3-20357514c794 is going to be updated. [ 803.063970] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.064144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.064212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.064431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.064580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.071033] env[69692]: INFO networking_nsxv3.common.synchronization [req-addd1941-7113-44e7-92c1-b6ad314ffd11 req-172d3df1-2e3d-40b4-a12c-b992ce2adacb service nova] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_rules [ 803.071033] env[69692]: INFO networking_nsxv3.common.synchronization [req-addd1941-7113-44e7-92c1-b6ad314ffd11 req-172d3df1-2e3d-40b4-a12c-b992ce2adacb service nova] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 803.071251] env[69692]: INFO networking_nsxv3.common.synchronization [req-addd1941-7113-44e7-92c1-b6ad314ffd11 req-172d3df1-2e3d-40b4-a12c-b992ce2adacb service nova] Enqueued Resource ID: 48799df7-5d7b-414b-bd2b-a318c43afd3e with Priority: HIGHEST for action port [ 803.071600] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_rules [ 803.071730] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 803.071825] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48799df7-5d7b-414b-bd2b-a318c43afd3e with Priority: HIGHEST for action port [ 803.072179] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.072289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.072323] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.072964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.072964] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.073816] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.073918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.074134] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-48799df7-5d7b-414b-bd2b-a318c43afd3e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.074236] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.074302] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.074475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.074564] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48799df7-5d7b-414b-bd2b-a318c43afd3e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.076228] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: IN_PROGRESS for 2s [ 803.576769] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.577062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.577121] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48799df7-5d7b-414b-bd2b-a318c43afd3e with status ACTIVE [ 803.577289] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.577421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.577509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.577698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.577787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.577974] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.578089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.578142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.578311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.578459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.578596] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.578694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.578743] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.578954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.578989] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.579086] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48799df7-5d7b-414b-bd2b-a318c43afd3e is going to be updated. [ 803.600873] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.600873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.600873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.600873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.600873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.600873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.665058] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92949372-ad62-4c3b-ab83-73cb755bd4de in Status: SUCCESS [ 803.665355] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92949372-ad62-4c3b-ab83-73cb755bd4de deletion is rescheduled due to dependency. [ 803.665525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.504105] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 804.504105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.504105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.504105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.504105] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.504105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.504105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.504105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.504105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.504105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.504105] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.569886] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6ffdfa8-6380-47fd-b801-823581edd625 in Status: SUCCESS [ 804.570705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.640054] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 804.640054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.640054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.640054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.640054] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.640054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.640054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.640054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.640054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.640054] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.010684] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.010684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.010684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.010684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.010684] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.010684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.010684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.010684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.010684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.010684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.010684] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.010684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.010684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.010684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.010684] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.010684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.011370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.011370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.011370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.011370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.011370] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.090123] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: SUCCESS [ 805.090123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.091370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.091370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.091370] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.141252] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.513136] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcbeb6f9-c515-4ff5-9c1f-1b944526d767: rpc.has_security_group_logging(os_id): False [ 805.531045] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.531045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.531045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.531045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.531865] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.533849] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.533849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.533849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.533849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.533849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.533849] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.533849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.533849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.533849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.533849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.533849] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.533849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.533849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.533849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.534391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.534391] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be created. [ 805.591475] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.591657] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.591698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.591937] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.592140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.593282] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.593399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.593468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.593635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.593782] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.593877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.593941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.596185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.596283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.596375] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.596464] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.610206] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 805.643671] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.006466] env[69692]: INFO networking_nsxv3.common.synchronization [req-51936791-2bec-4d6c-a5bc-7901cc03678a req-df53a641-f6f8-441f-92b1-8cbf72520b63 tempest-ServersAdminTestJSON-1982348900 tempest-ServersAdminTestJSON-1982348900-project-member] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 806.009959] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 806.010796] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.010962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.011066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.011341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.011567] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.012511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.012511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.012511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.012511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.012511] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.099932] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.099932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.099932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.100144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.100200] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.100313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.101031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.101031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.101031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.101031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.101031] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.101031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.101363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.101363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.101363] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.101460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.101576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.101677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.101755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.101832] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.101913] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.149520] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.149520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.149683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.149787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.153107] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.153107] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 806.179057] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.179233] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.179318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.180439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.180439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.191287] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 806.434688] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.434960] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.435162] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.435420] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.435774] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.436365] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.436365] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.436885] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.437220] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.437542] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.437876] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.438054] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.438180] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.438395] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.438459] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.438568] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.463425] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.463562] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.463766] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.463950] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.464296] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.464502] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.464629] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.465061] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.465251] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.514712] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.604394] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 803064c7-17f8-46ee-bdf3-20357514c794: rpc.has_security_group_logging(os_id): False [ 806.621739] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.622147] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.622147] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.622271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.622376] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.622610] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.622724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.622788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.622968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.623055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.623266] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.623356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.623453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.623812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.623812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.623980] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.624153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.624250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.624474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.624593] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.624712] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 803064c7-17f8-46ee-bdf3-20357514c794 is going to be updated. [ 806.694475] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.694808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.694808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.694938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.695117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.708164] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: IN_PROGRESS for 2s [ 806.967769] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.968038] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.968192] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.968479] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.968641] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.968800] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af not found, creating... [ 806.969087] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.969247] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.969376] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.969607] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.969747] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.970056] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.970241] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.970366] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.970579] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.970717] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.970876] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af is going to be created. [ 806.990906] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.990906] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.991123] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.991331] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.992488] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.992488] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.017479] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.265271] env[69692]: INFO networking_nsxv3.common.synchronization [req-ad1630ab-b23e-41f4-ab68-b463a94dfade req-47861475-745e-4368-a36f-4f0adb5a109c tempest-InstanceActionsTestJSON-155023934 tempest-InstanceActionsTestJSON-155023934-project-member] Enqueued Resource ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 with Priority: HIGHEST for action security_group_members [ 807.265790] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 with Priority: HIGHEST for action security_group_members [ 807.266558] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.266558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.266558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.266558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.266750] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.266750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.266750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.266951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.267028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.267147] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.521881] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.521881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.521881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.521881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.521881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.521881] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 807.547953] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.547953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.547953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.547953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.548316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.557329] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 807.626195] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 807.626432] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.769622] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.770022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.770022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.770088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.770176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.770360] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.770458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.770517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.770675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.770753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.770843] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 is going to be updated. [ 807.804616] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.804865] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.805015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.805341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.805656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.810061] env[69692]: INFO networking_nsxv3.common.synchronization [req-51936791-2bec-4d6c-a5bc-7901cc03678a req-657f2466-fc7c-44f5-8999-2637e22ad3a9 service nova] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_rules [ 807.812270] env[69692]: INFO networking_nsxv3.common.synchronization [req-51936791-2bec-4d6c-a5bc-7901cc03678a req-657f2466-fc7c-44f5-8999-2637e22ad3a9 service nova] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 807.812552] env[69692]: INFO networking_nsxv3.common.synchronization [req-51936791-2bec-4d6c-a5bc-7901cc03678a req-657f2466-fc7c-44f5-8999-2637e22ad3a9 service nova] Enqueued Resource ID: d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af with Priority: HIGHEST for action port [ 807.813354] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_rules [ 807.813566] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 807.813735] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af with Priority: HIGHEST for action port [ 807.814165] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.814353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.814467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.814762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.815202] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.817982] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.819745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.819745] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.819745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.819745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.819745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.819745] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.822088] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 in Status: IN_PROGRESS for 2s [ 808.070702] env[69692]: INFO networking_nsxv3.common.synchronization [req-be5643b6-cebe-4e47-86e6-63108a09028f req-51ddc147-b6c3-43b6-a1e8-1738953f2d99 tempest-ListServerFiltersTestJSON-797986437 tempest-ListServerFiltersTestJSON-797986437-project-member] Enqueued Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 808.071259] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 808.071567] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.071692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.071773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.072018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.072653] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.072810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.072909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.073121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.073731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.073731] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.211550] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 808.211772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.212307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.212570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.212772] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.212888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.212967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.213133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.213279] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.213366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.213456] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.321954] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.322355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.323798] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af with status ACTIVE [ 808.324227] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.324478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.324615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.324961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.325141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.325442] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.325614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.325730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.326068] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.326234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.326539] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.326877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.326877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.330118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.330280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.330387] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af is going to be updated. [ 808.353426] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.353569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.353634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.353845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.353979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.354171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9c0c3a3-b4eb-4e1b-ba2c-036a71f081af" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.549660] env[69692]: INFO networking_nsxv3.common.synchronization [req-67d49007-e390-4852-9721-30e64e78e96c req-d176f950-f9b8-4c69-91c0-19dca3e20b90 tempest-ServerAddressesTestJSON-345913374 tempest-ServerAddressesTestJSON-345913374-project-member] Enqueued Resource ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 with Priority: HIGHEST for action security_group_members [ 808.550399] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 with Priority: HIGHEST for action security_group_members [ 808.550875] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.551082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.551160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.551574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.551686] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.551827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.551927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.552173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.552309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.552509] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8b96c18-8a3b-48f3-8303-8b48b5735ba8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.576108] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.717415] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.717571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.717661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.717877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.718075] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.718202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.718269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.718422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.718509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.718596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.718739] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.718834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.718896] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.719055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.719203] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.719293] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.719353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.719489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.719589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.719688] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.719787] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.721920] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: SUCCESS [ 808.722151] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.054871] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.055203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.055262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.055587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.055708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.056010] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.056176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.056277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.056516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.056640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.056771] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 already deleted. [ 809.056903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.080128] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.189457] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-294 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.189696] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-294" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.189883] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-294" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.190475] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-294" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.190799] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.191101] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.191297] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.191642] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.191855] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.192206] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.192382] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.192562] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.192735] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.192935] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.193148] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.193385] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.215300] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.215512] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.215905] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.215979] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-294" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.216301] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.216488] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.216611] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.216939] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.217137] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.223439] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c88a973-e953-4cb7-bda1-829fc68b91a4: rpc.has_security_group_logging(os_id): False [ 809.246562] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.246562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.246562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.246562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.265546] env[69692]: INFO networking_nsxv3.common.synchronization [req-d8865f62-5dfe-44a8-9596-a246150a1d4c req-647213b8-5a6c-4bb6-925d-2843197a787a tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 809.266056] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 809.266374] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.266484] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.266552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.266817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.266971] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.267304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.267365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.267529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.267612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.267708] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.269251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.269462] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.269566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.269629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.269785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.269884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.273026] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.273026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.273026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.273026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.273026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.273026] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.273026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.273026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.273026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.273026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.273026] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 809.329583] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.329755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.329851] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.330148] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.330355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.343959] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 809.567214] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 809.567214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.567443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.567642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.567825] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.567946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.568025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.568170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.568253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.568361] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.582494] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.582641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.582712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.582917] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.583023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.583121] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 is going to be updated. [ 809.608034] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.608197] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.608331] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.608637] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.608901] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.609075] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.609199] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.609419] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.609568] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.609797] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.609921] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.610045] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.610158] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.610286] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.610403] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.610539] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.613076] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.613220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.613264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.613486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.613639] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.623729] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: IN_PROGRESS for 2s [ 809.632555] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.632733] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.632880] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.633089] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.633409] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-9743d607-8ecc-45a8-b02e-58516a776cb6 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.633585] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-9743d607-8ecc-45a8-b02e-58516a776cb6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.633706] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-9743d607-8ecc-45a8-b02e-58516a776cb6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.634069] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-9743d607-8ecc-45a8-b02e-58516a776cb6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.634217] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9743d607-8ecc-45a8-b02e-58516a776cb6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.719739] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.720012] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.720243] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.720554] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.720740] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.720989] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7 not found, creating... [ 809.721326] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.721500] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.721625] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.721893] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.722040] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.722383] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.722497] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.722611] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.722823] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.722956] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.723112] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7 is going to be created. [ 809.741721] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.741999] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.742109] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.742366] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.742596] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.742816] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.773534] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.773728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.773787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.773991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.774100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.774291] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.774393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.774458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.774604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.774680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.774764] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b already deleted. [ 809.774843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.832541] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 in Status: SUCCESS [ 809.832693] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 deletion is rescheduled due to dependency. [ 809.832826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.073259] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.136817] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.136817] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.136984] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.137258] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.137414] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.137577] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 9743d607-8ecc-45a8-b02e-58516a776cb6 not found, creating... [ 810.137845] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.138023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.138146] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.138445] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.138774] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.139055] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.139224] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.139347] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.139598] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.139695] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.139838] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 9743d607-8ecc-45a8-b02e-58516a776cb6 is going to be created. [ 810.160502] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.160738] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.160913] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.161213] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.161450] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.161675] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-9743d607-8ecc-45a8-b02e-58516a776cb6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.527888] env[69692]: INFO networking_nsxv3.common.synchronization [req-67d49007-e390-4852-9721-30e64e78e96c req-c0a3c569-9531-4882-be69-488878720b46 service nova] Enqueued Resource ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 with Priority: HIGHEST for action security_group_rules [ 810.528086] env[69692]: INFO networking_nsxv3.common.synchronization [req-67d49007-e390-4852-9721-30e64e78e96c req-c0a3c569-9531-4882-be69-488878720b46 service nova] Enqueued Resource ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 with Priority: HIGHEST for action security_group_members [ 810.528230] env[69692]: INFO networking_nsxv3.common.synchronization [req-67d49007-e390-4852-9721-30e64e78e96c req-c0a3c569-9531-4882-be69-488878720b46 service nova] Enqueued Resource ID: 3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7 with Priority: HIGHEST for action port [ 810.529281] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 with Priority: HIGHEST for action security_group_rules [ 810.529431] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 with Priority: HIGHEST for action security_group_members [ 810.529537] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7 with Priority: HIGHEST for action port [ 810.529822] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8b96c18-8a3b-48f3-8303-8b48b5735ba8 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.529947] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.530027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.530301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.530387] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8b96c18-8a3b-48f3-8303-8b48b5735ba8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.531772] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.531968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.531968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.532266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.532342] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.532474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.532474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.533199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.533199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.533199] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8b96c18-8a3b-48f3-8303-8b48b5735ba8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.533490] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.533590] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.533644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.533833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.533833] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.575738] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.909733] env[69692]: INFO networking_nsxv3.common.synchronization [req-d8865f62-5dfe-44a8-9596-a246150a1d4c req-c1cf6fdf-6ec5-470f-b94b-e29d18337a29 service nova] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_rules [ 810.909733] env[69692]: INFO networking_nsxv3.common.synchronization [req-d8865f62-5dfe-44a8-9596-a246150a1d4c req-c1cf6fdf-6ec5-470f-b94b-e29d18337a29 service nova] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 810.909845] env[69692]: INFO networking_nsxv3.common.synchronization [req-d8865f62-5dfe-44a8-9596-a246150a1d4c req-c1cf6fdf-6ec5-470f-b94b-e29d18337a29 service nova] Enqueued Resource ID: 9743d607-8ecc-45a8-b02e-58516a776cb6 with Priority: HIGHEST for action port [ 810.911037] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_rules [ 810.911037] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 810.911037] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9743d607-8ecc-45a8-b02e-58516a776cb6 with Priority: HIGHEST for action port [ 810.911037] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.911037] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.911037] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.911430] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.911430] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.912390] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.912390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.912390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.912540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.912575] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.912659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.912720] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.912858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.912943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.913043] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.913743] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-9743d607-8ecc-45a8-b02e-58516a776cb6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.913847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9743d607-8ecc-45a8-b02e-58516a776cb6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.913915] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9743d607-8ecc-45a8-b02e-58516a776cb6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.914074] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9743d607-8ecc-45a8-b02e-58516a776cb6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.914147] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9743d607-8ecc-45a8-b02e-58516a776cb6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.036172] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.036172] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.036342] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7 with status ACTIVE [ 811.037226] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.037226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.037226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.037226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.037226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.037226] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.037226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.037613] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.037613] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.037613] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.037706] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.037757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.037791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.037931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.038010] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.038173] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7 is going to be updated. [ 811.039376] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8b96c18-8a3b-48f3-8303-8b48b5735ba8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.058602] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.058806] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.058914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.059149] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.059311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.059433] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a2f6d6e-8bdf-434d-ad9b-df34767dc0f7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.080024] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.080024] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.080024] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.080369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.080369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.080495] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 811.106913] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.107069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.107132] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.107339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.107471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.119757] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 811.358557] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 811.358775] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.415423] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.415551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.415744] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.416687] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9743d607-8ecc-45a8-b02e-58516a776cb6 with status ACTIVE [ 811.416866] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.416976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.417052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.417261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.417347] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.417513] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.417825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.417825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.417825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.417957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.418082] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.418332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.418332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.418509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.418509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.418589] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9743d607-8ecc-45a8-b02e-58516a776cb6 is going to be updated. [ 811.438379] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.438575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.438687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.438976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.439235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.439473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9743d607-8ecc-45a8-b02e-58516a776cb6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.541853] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8b96c18-8a3b-48f3-8303-8b48b5735ba8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.633075] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: SUCCESS [ 811.633374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.920408] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.044147] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.044398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.044398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.044668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.044770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.044903] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 is going to be created. [ 812.066492] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.066642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.066732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.066940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.067112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.077852] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 in Status: UNINITIALIZED for 2s [ 812.423493] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.423861] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.423861] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.424201] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.424350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.424554] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be created. [ 812.456011] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.456254] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.456316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.456641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.457585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.468716] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: UNINITIALIZED for 2s [ 813.129329] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 4s [ 813.263094] env[69692]: INFO networking_nsxv3.common.synchronization [req-62371c4a-d8d5-4d41-879c-11e9bf11850d req-845d2a6c-52ce-48f3-a6c4-de86f35a2cb1 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 813.264276] env[69692]: INFO networking_nsxv3.common.synchronization [req-62371c4a-d8d5-4d41-879c-11e9bf11850d req-845d2a6c-52ce-48f3-a6c4-de86f35a2cb1 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_members [ 813.265076] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 813.265306] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_members [ 813.266707] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.267164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.267164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.267164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.267337] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.267424] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.267532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.267947] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.268061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.268171] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.269377] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-592d30d0-26f8-4498-ae9a-adafe7d95eb3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.270764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.270878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.271162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.271351] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.271610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.271610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.271665] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.271773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.271897] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.315516] env[69692]: INFO networking_nsxv3.common.synchronization [req-02266b48-db15-4026-adfc-3a12ef8344ac req-875b68c5-a032-463c-839f-dd055f2c9dc8 tempest-MultipleCreateTestJSON-73038672 tempest-MultipleCreateTestJSON-73038672-project-member] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 813.316710] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 813.317771] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.317899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.317972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.318238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.318403] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.318504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.318568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.318708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.318792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.318889] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.328182] env[69692]: INFO networking_nsxv3.common.synchronization [req-62371c4a-d8d5-4d41-879c-11e9bf11850d req-845d2a6c-52ce-48f3-a6c4-de86f35a2cb1 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_rules [ 813.328182] env[69692]: INFO networking_nsxv3.common.synchronization [req-62371c4a-d8d5-4d41-879c-11e9bf11850d req-845d2a6c-52ce-48f3-a6c4-de86f35a2cb1 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 813.328341] env[69692]: INFO networking_nsxv3.common.synchronization [req-62371c4a-d8d5-4d41-879c-11e9bf11850d req-845d2a6c-52ce-48f3-a6c4-de86f35a2cb1 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_rules [ 813.328432] env[69692]: INFO networking_nsxv3.common.synchronization [req-62371c4a-d8d5-4d41-879c-11e9bf11850d req-845d2a6c-52ce-48f3-a6c4-de86f35a2cb1 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_members [ 813.328566] env[69692]: INFO networking_nsxv3.common.synchronization [req-62371c4a-d8d5-4d41-879c-11e9bf11850d req-845d2a6c-52ce-48f3-a6c4-de86f35a2cb1 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 48799df7-5d7b-414b-bd2b-a318c43afd3e with Priority: HIGHEST for action port [ 813.328780] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_rules [ 813.328903] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_rules [ 813.329009] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48799df7-5d7b-414b-bd2b-a318c43afd3e with Priority: HIGHEST for action port [ 813.329106] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 813.329464] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_members [ 813.329689] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.329809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.329886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.330224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.330340] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.331464] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-592d30d0-26f8-4498-ae9a-adafe7d95eb3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.331636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.331725] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.331965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.332087] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.332847] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-48799df7-5d7b-414b-bd2b-a318c43afd3e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.332991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.333097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.333295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.333401] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48799df7-5d7b-414b-bd2b-a318c43afd3e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.335604] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.335709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.335911] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-592d30d0-26f8-4498-ae9a-adafe7d95eb3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.336045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.706688] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-473 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.707093] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.707093] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.707412] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.707691] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.707847] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.707968] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.708205] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.708352] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.708562] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.708677] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.709203] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.709372] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.709491] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.709601] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.709736] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.728555] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.728774] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 813.728961] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.729182] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.729485] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-b53117e0-8155-4b97-93f3-37a254c7cc25 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.729661] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-b53117e0-8155-4b97-93f3-37a254c7cc25" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.729784] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-b53117e0-8155-4b97-93f3-37a254c7cc25" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.730198] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-b53117e0-8155-4b97-93f3-37a254c7cc25" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.730364] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b53117e0-8155-4b97-93f3-37a254c7cc25',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.773537] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.775799] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.821452] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.821610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.821683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.821924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.822077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.822280] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.822381] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.822445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.822605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.822683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.822767] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 already deleted. [ 813.822848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.837504] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-592d30d0-26f8-4498-ae9a-adafe7d95eb3 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.837636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.838351] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.838493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.838666] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48799df7-5d7b-414b-bd2b-a318c43afd3e with status ACTIVE [ 813.838932] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.839094] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.839179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.839429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.839547] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.839749] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.839869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.839938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.840133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.840240] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.840435] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.840552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.840629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.840779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.840907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.841028] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48799df7-5d7b-414b-bd2b-a318c43afd3e is going to be updated. [ 813.862866] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.862866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.862866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.862866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.862866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.862866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.086535] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 in Status: SUCCESS [ 814.086758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.087129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.087293] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.087343] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.087514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.087514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.087655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.087703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.087870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.087870] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8b96c18-8a3b-48f3-8303-8b48b5735ba8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.232758] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.233069] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.233258] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.233593] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.233806] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.234008] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port b53117e0-8155-4b97-93f3-37a254c7cc25 not found, creating... [ 814.234339] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.234521] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.234668] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.234937] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.235125] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.235655] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.236313] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.236512] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.236762] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.236915] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.237073] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: b53117e0-8155-4b97-93f3-37a254c7cc25 is going to be created. [ 814.256517] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.256911] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.257024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.257312] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.257545] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.257832] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-b53117e0-8155-4b97-93f3-37a254c7cc25" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.277750] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.278790] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.480410] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 814.480410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.480410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.480410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.480410] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.480410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.480410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.480410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.480410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.480410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.480410] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.590909] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.591152] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.591249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.591534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.591778] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.591915] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.592015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.592223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.592341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.592462] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.592662] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.592800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.592868] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.593028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.593176] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.593270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.593331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.593470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.593547] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.593627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.593716] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8b96c18-8a3b-48f3-8303-8b48b5735ba8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.781883] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.782197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.782197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.782862] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.782862] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.782862] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 814.783862] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.783971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.784051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.784401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.784401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.784401] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 is going to be created. [ 814.810081] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.810081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.810081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.810081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.810081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.811273] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.812042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.812042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.812042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.812042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.817694] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: UNINITIALIZED for 2s [ 814.818330] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 814.983586] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.983791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.983843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.984084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.984247] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.984350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.984416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.984563] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.984669] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.984759] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.984906] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.985055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.985182] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.985343] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.985582] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.985680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.985775] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.986014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.986129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.986256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.986407] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.026907] env[69692]: INFO networking_nsxv3.common.synchronization [req-02266b48-db15-4026-adfc-3a12ef8344ac req-4efb22ea-b039-4e1b-bfd0-9d4254cf222a service nova] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_rules [ 815.026907] env[69692]: INFO networking_nsxv3.common.synchronization [req-02266b48-db15-4026-adfc-3a12ef8344ac req-4efb22ea-b039-4e1b-bfd0-9d4254cf222a service nova] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 815.026907] env[69692]: INFO networking_nsxv3.common.synchronization [req-02266b48-db15-4026-adfc-3a12ef8344ac req-4efb22ea-b039-4e1b-bfd0-9d4254cf222a service nova] Enqueued Resource ID: b53117e0-8155-4b97-93f3-37a254c7cc25 with Priority: HIGHEST for action port [ 815.027037] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_rules [ 815.027164] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 815.027302] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b53117e0-8155-4b97-93f3-37a254c7cc25 with Priority: HIGHEST for action port [ 815.030731] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.030854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.030938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.031229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.031563] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.032847] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.033286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.033483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.033703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.033910] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.034021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.034085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.034239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.034321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.034418] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.035345] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-b53117e0-8155-4b97-93f3-37a254c7cc25 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.035454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b53117e0-8155-4b97-93f3-37a254c7cc25" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.035514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b53117e0-8155-4b97-93f3-37a254c7cc25" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.035666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b53117e0-8155-4b97-93f3-37a254c7cc25" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.035741] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b53117e0-8155-4b97-93f3-37a254c7cc25',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.095881] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8b96c18-8a3b-48f3-8303-8b48b5735ba8: rpc.has_security_group_logging(os_id): False [ 815.112808] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.112996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.113049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.113364] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.113514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.113745] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.113865] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.114015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.114207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.114836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.114836] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.114836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.114836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.114836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.115114] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.115114] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.115223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.115223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.115330] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.115404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.115491] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 is going to be created. [ 815.137912] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 815.138137] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.138319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.138517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.138703] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.138816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.138878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.139040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.139145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.139253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.139366] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.181047] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.181434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.181567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.181805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.182194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.210364] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 in Status: IN_PROGRESS for 2s [ 815.491343] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0602c86f-34c6-42e5-a101-35f6c95de05b: rpc.has_security_group_logging(os_id): False [ 815.510647] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.510647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.510647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.510647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.510966] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.511010] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.511122] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.511181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.511349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.511429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.511624] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.511726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.511789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.512025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.512101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.512303] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.512400] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.512463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.512605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.512680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.512765] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be created. [ 815.538158] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b53117e0-8155-4b97-93f3-37a254c7cc25 with status ACTIVE [ 815.538539] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.538803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.538803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.538986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.539136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.539419] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.539589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.539662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.539822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.539988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.540238] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.540392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.540491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.540703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.540805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.541176] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b53117e0-8155-4b97-93f3-37a254c7cc25 is going to be updated. [ 815.542362] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.543473] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.543649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.582197] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.582405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.582506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.582773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.582906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.583117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b53117e0-8155-4b97-93f3-37a254c7cc25" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.584411] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.584603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.584695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.584892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.585100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.597917] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 815.641724] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.641724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.641724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.641858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.641946] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.642039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.642104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.642288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.642387] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.642512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.642618] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.642706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.642766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.642909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.643058] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.643153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.643221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.643384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.643478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.643562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.643667] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.915425] env[69692]: INFO networking_nsxv3.common.synchronization [req-02266b48-db15-4026-adfc-3a12ef8344ac req-f0268717-5468-42d7-ac32-ccd4bf00f499 tempest-MultipleCreateTestJSON-73038672 tempest-MultipleCreateTestJSON-73038672-project-member] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 815.915929] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 815.916304] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.916419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.045378] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.146626] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aade30ad-1e65-411f-be2a-2831f287cfbc: rpc.has_security_group_logging(os_id): False [ 816.163968] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.164148] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.164222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.164436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.165047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.165307] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.165452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.165485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.166245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.166245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.166245] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.166245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.166245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.166245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.166526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.166526] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.166597] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.166628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.166757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.166832] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.166918] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 816.242019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.242019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.242019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.242019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.242019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.256089] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 816.502233] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-473 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.502446] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.502582] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.502859] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.503295] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.503507] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.506525] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.506525] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.506525] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.506525] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.506525] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.506525] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.506525] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.506525] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 816.506525] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.506525] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.530801] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.531082] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 816.531263] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.531609] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.532289] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-1d979e62-074e-4f8b-b915-992688ee5de5 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.532609] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-1d979e62-074e-4f8b-b915-992688ee5de5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.532898] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-1d979e62-074e-4f8b-b915-992688ee5de5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.533389] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-1d979e62-074e-4f8b-b915-992688ee5de5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.533610] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d979e62-074e-4f8b-b915-992688ee5de5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.549659] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.549954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.550085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.550384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.550534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.550699] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be created. [ 816.576135] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.580025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.580025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.580025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.580025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.590521] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: UNINITIALIZED for 2s [ 816.829651] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: SUCCESS [ 816.829883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.830067] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.830789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.830789] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.830789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.830789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.831967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.831967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.831967] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.832467] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 816.832630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.832770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.832928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.833095] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.833193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.833276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.833443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.834407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.834407] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.037233] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.037639] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.037860] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.037975] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.038124] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.038294] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 1d979e62-074e-4f8b-b915-992688ee5de5 not found, creating... [ 817.038568] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.038729] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.038862] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.042842] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.043062] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.043518] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.043727] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.043854] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.044146] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.044283] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.044432] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 1d979e62-074e-4f8b-b915-992688ee5de5 is going to be created. [ 817.068029] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.068323] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.068564] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.068930] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.069193] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.069427] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-1d979e62-074e-4f8b-b915-992688ee5de5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.223888] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 in Status: SUCCESS [ 817.224642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.335296] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.340020] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.614953] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 817.615031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.840419] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.842670] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.984372] env[69692]: INFO networking_nsxv3.common.synchronization [req-02266b48-db15-4026-adfc-3a12ef8344ac req-462bff08-7d9e-4ed3-964e-611601db472d service nova] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_rules [ 817.984372] env[69692]: INFO networking_nsxv3.common.synchronization [req-02266b48-db15-4026-adfc-3a12ef8344ac req-462bff08-7d9e-4ed3-964e-611601db472d service nova] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 817.984372] env[69692]: INFO networking_nsxv3.common.synchronization [req-02266b48-db15-4026-adfc-3a12ef8344ac req-462bff08-7d9e-4ed3-964e-611601db472d service nova] Enqueued Resource ID: 1d979e62-074e-4f8b-b915-992688ee5de5 with Priority: HIGHEST for action port [ 817.984372] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_rules [ 817.984372] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 817.984372] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d979e62-074e-4f8b-b915-992688ee5de5 with Priority: HIGHEST for action port [ 817.984372] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.984372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.984372] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.984372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.984372] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d979e62-074e-4f8b-b915-992688ee5de5 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.985250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d979e62-074e-4f8b-b915-992688ee5de5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.985250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d979e62-074e-4f8b-b915-992688ee5de5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.985250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d979e62-074e-4f8b-b915-992688ee5de5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.985250] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d979e62-074e-4f8b-b915-992688ee5de5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.273877] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 818.274776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.344371] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.344445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.344515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.344732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.344829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.344929] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 is going to be updated. [ 818.346638] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.346751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.346822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.346996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.347704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.347841] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 818.387496] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.387654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.387733] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.387931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.388091] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.390569] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.391107] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.391228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.391438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.391722] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.401677] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 818.402620] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: IN_PROGRESS for 2s [ 818.487418] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d979e62-074e-4f8b-b915-992688ee5de5 with status ACTIVE [ 818.487674] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.487908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.488054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.488630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.488761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.489021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.489143] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.489210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.489380] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.489459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.489645] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.489740] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.489802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.489944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.490031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.490117] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d979e62-074e-4f8b-b915-992688ee5de5 is going to be updated. [ 818.510256] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.510486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.510486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.510693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.510831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.511032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d979e62-074e-4f8b-b915-992688ee5de5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.605038] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 818.605038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.605038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.605038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.605038] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.605038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.605038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.605038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.605038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.605038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.605038] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.605038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.605038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.605784] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.605784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.605784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.605784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.605784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.605784] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.107971] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.108086] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.108271] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.350569] env[69692]: INFO networking_nsxv3.common.synchronization [req-866cfea4-7256-495a-a3f8-84ede538a297 req-86eed576-a443-40f3-b506-86200fa9cd2e tempest-ServersTestManualDisk-923673515 tempest-ServersTestManualDisk-923673515-project-member] Enqueued Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGHEST for action security_group_members [ 819.351145] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGHEST for action security_group_members [ 819.351463] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.351561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.351630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.353845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.354136] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.354308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.355654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.355654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.355654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.355654] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3aeeb294-14c6-4fb6-bbb6-67a12deabbef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.611504] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.858205] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.860220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.860220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.860220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.860220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.860220] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.860220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.860220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.860220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.860220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.860220] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef already deleted. [ 819.860220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.118977] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-595 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.121262] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-595" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.121582] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-595" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.123658] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-595" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.124754] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.125284] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.125530] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.125896] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.126162] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.126488] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.126705] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.126926] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.127152] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.127823] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.128330] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.128748] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.130624] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.130942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.131154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.131459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.132092] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.132303] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be updated. [ 820.151251] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.152256] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 820.152640] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.152940] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-595" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.153388] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-f8f3f8f8-2841-49d5-818a-289827ce2b23 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.154390] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-f8f3f8f8-2841-49d5-818a-289827ce2b23" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.155881] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-f8f3f8f8-2841-49d5-818a-289827ce2b23" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.155881] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-f8f3f8f8-2841-49d5-818a-289827ce2b23" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.155881] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8f3f8f8-2841-49d5-818a-289827ce2b23',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.161378] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.161378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.161378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.161378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.161378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.170259] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 820.413235] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: SUCCESS [ 820.413519] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.414479] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 820.414705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.415225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.415596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.415921] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.416082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.416374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.416655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.417753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.417872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.417975] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.422257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.422257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.422257] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.422257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.422257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.422257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.422257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.422257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.422257] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.660359] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.660359] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.660540] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.660805] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.661110] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.661427] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port f8f3f8f8-2841-49d5-818a-289827ce2b23 not found, creating... [ 820.661746] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.661926] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.662164] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.662457] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.662606] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.662935] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.663506] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.663645] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.663886] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.664036] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.664190] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: f8f3f8f8-2841-49d5-818a-289827ce2b23 is going to be created. [ 820.685160] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.685160] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.685160] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.685437] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.685716] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.686142] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-f8f3f8f8-2841-49d5-818a-289827ce2b23" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.874273] env[69692]: INFO networking_nsxv3.common.synchronization [None req-0b22af05-9fb9-421b-9bb7-76550f6518ea None None] Enqueued Resource ID: 51b91fd2-e17d-4d7e-a66b-da0477c53b30 with Priority: HIGHEST for action port [ 820.877154] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51b91fd2-e17d-4d7e-a66b-da0477c53b30 with Priority: HIGHEST for action port [ 820.878515] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-51b91fd2-e17d-4d7e-a66b-da0477c53b30 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.878986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51b91fd2-e17d-4d7e-a66b-da0477c53b30" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.879204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51b91fd2-e17d-4d7e-a66b-da0477c53b30" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.880757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51b91fd2-e17d-4d7e-a66b-da0477c53b30" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.880757] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51b91fd2-e17d-4d7e-a66b-da0477c53b30',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.927311] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.927311] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.927311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.927311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.927311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.927311] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.927311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.927311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.927311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.927311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.929095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.929442] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.929736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.929915] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.930211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.930525] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.930772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.930979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.931301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.931951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.932495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.932495] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.384667] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51b91fd2-e17d-4d7e-a66b-da0477c53b30 [ 821.384667] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.384667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.384667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.384667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.384667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.384667] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51b91fd2-e17d-4d7e-a66b-da0477c53b30 already deleted. [ 821.384667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51b91fd2-e17d-4d7e-a66b-da0477c53b30" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.426206] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 592d30d0-26f8-4498-ae9a-adafe7d95eb3: rpc.has_security_group_logging(os_id): False [ 821.438140] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c88a973-e953-4cb7-bda1-829fc68b91a4: rpc.has_security_group_logging(os_id): False [ 821.446171] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.446290] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.446425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.446574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.446656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.446873] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.446977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.447039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.447181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.447684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.447684] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 is going to be created. [ 821.453673] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.453799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.453869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.454068] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.454193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.454380] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.454474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.454534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.454724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.454799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.454986] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.455160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.455160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.455311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.455382] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.455585] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.455758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.455819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.455960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.456049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.456158] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 821.518493] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.518676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.518719] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.518980] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.519528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.543345] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: IN_PROGRESS for 2s [ 821.551490] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.551865] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.551865] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.552727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.552898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.578780] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 821.605027] env[69692]: INFO networking_nsxv3.common.synchronization [req-866cfea4-7256-495a-a3f8-84ede538a297 req-d5a05bbf-295c-4ff1-abba-d0604a3b32b0 service nova] Enqueued Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGHEST for action security_group_rules [ 821.605027] env[69692]: INFO networking_nsxv3.common.synchronization [req-866cfea4-7256-495a-a3f8-84ede538a297 req-d5a05bbf-295c-4ff1-abba-d0604a3b32b0 service nova] Enqueued Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGHEST for action security_group_members [ 821.605258] env[69692]: INFO networking_nsxv3.common.synchronization [req-866cfea4-7256-495a-a3f8-84ede538a297 req-d5a05bbf-295c-4ff1-abba-d0604a3b32b0 service nova] Enqueued Resource ID: f8f3f8f8-2841-49d5-818a-289827ce2b23 with Priority: HIGHEST for action port [ 821.605321] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGHEST for action security_group_rules [ 821.605454] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGHEST for action security_group_members [ 821.605572] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f3f8f8-2841-49d5-818a-289827ce2b23 with Priority: HIGHEST for action port [ 821.609114] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.609271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.609424] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.609598] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.609690] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3aeeb294-14c6-4fb6-bbb6-67a12deabbef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.611134] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.611785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.611785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.611785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.611785] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.611785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.611976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.611976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.613029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.613138] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3aeeb294-14c6-4fb6-bbb6-67a12deabbef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.614659] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8f3f8f8-2841-49d5-818a-289827ce2b23 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.614796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8f3f8f8-2841-49d5-818a-289827ce2b23" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.614854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8f3f8f8-2841-49d5-818a-289827ce2b23" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.614990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8f3f8f8-2841-49d5-818a-289827ce2b23" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.616295] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8f3f8f8-2841-49d5-818a-289827ce2b23',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.031729] env[69692]: INFO networking_nsxv3.common.synchronization [None req-d7d71c30-e0b4-46a6-bd41-702b166ff9e3 tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGHEST for action security_group_rules [ 822.032405] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGHEST for action security_group_rules [ 822.033055] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4a9da48-db34-4124-bc5a-acf3f884fbec taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.033174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.033216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.033530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.033616] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.117546] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.117682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.119155] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3aeeb294-14c6-4fb6-bbb6-67a12deabbef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.120371] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8f3f8f8-2841-49d5-818a-289827ce2b23 with status ACTIVE [ 822.120626] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.121072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.121072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.121072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.121176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.121361] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.121477] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.121556] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.121778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.121870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.122223] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.122404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.122500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.122728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.122860] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.122976] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8f3f8f8-2841-49d5-818a-289827ce2b23 is going to be updated. [ 822.144176] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.144176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.144295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.144470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.144599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.144770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8f3f8f8-2841-49d5-818a-289827ce2b23" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.169110] env[69692]: INFO networking_nsxv3.common.synchronization [None req-3b66d8c7-68e4-48b7-a3a1-b3190048fc09 tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGHEST for action security_group_rules [ 822.169614] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGHEST for action security_group_rules [ 822.169926] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4a9da48-db34-4124-bc5a-acf3f884fbec taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.170044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.174045] env[69692]: INFO networking_nsxv3.common.synchronization [req-a626c9f7-1981-4777-aab7-dedb633be5bb req-dfdcfcec-6ea9-4120-a4fb-08b6eff9b2f8 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 822.174220] env[69692]: INFO networking_nsxv3.common.synchronization [req-a626c9f7-1981-4777-aab7-dedb633be5bb req-dfdcfcec-6ea9-4120-a4fb-08b6eff9b2f8 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 with Priority: HIGHEST for action security_group_members [ 822.174356] env[69692]: INFO networking_nsxv3.common.synchronization [req-a626c9f7-1981-4777-aab7-dedb633be5bb req-dfdcfcec-6ea9-4120-a4fb-08b6eff9b2f8 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_members [ 822.178595] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 822.178743] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 with Priority: HIGHEST for action security_group_members [ 822.178874] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_members [ 822.179401] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.179517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.179581] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.179771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.179920] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.180045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.180110] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.180265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.180361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.180482] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.181349] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c444bda-b43d-4fc8-a3ca-afe327ac3279 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.181472] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.181516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.181718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.181861] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.181952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.182020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.182157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.182231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.182316] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c444bda-b43d-4fc8-a3ca-afe327ac3279',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.184743] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-592d30d0-26f8-4498-ae9a-adafe7d95eb3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.184851] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.184914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.185079] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.185218] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.185310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.185368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.185497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.185569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.185660] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.192479] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 822.192479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.192479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.192479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.192679] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.194066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.194066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.194066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.194066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.194066] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.233912] env[69692]: INFO networking_nsxv3.common.synchronization [req-a626c9f7-1981-4777-aab7-dedb633be5bb req-dfdcfcec-6ea9-4120-a4fb-08b6eff9b2f8 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_rules [ 822.237230] env[69692]: INFO networking_nsxv3.common.synchronization [req-a626c9f7-1981-4777-aab7-dedb633be5bb req-dfdcfcec-6ea9-4120-a4fb-08b6eff9b2f8 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 822.237435] env[69692]: INFO networking_nsxv3.common.synchronization [req-a626c9f7-1981-4777-aab7-dedb633be5bb req-dfdcfcec-6ea9-4120-a4fb-08b6eff9b2f8 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_rules [ 822.237532] env[69692]: INFO networking_nsxv3.common.synchronization [req-a626c9f7-1981-4777-aab7-dedb633be5bb req-dfdcfcec-6ea9-4120-a4fb-08b6eff9b2f8 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_members [ 822.237672] env[69692]: INFO networking_nsxv3.common.synchronization [req-a626c9f7-1981-4777-aab7-dedb633be5bb req-dfdcfcec-6ea9-4120-a4fb-08b6eff9b2f8 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 with Priority: HIGHEST for action security_group_rules [ 822.237802] env[69692]: INFO networking_nsxv3.common.synchronization [req-a626c9f7-1981-4777-aab7-dedb633be5bb req-dfdcfcec-6ea9-4120-a4fb-08b6eff9b2f8 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 with Priority: HIGHEST for action security_group_members [ 822.237933] env[69692]: INFO networking_nsxv3.common.synchronization [req-a626c9f7-1981-4777-aab7-dedb633be5bb req-dfdcfcec-6ea9-4120-a4fb-08b6eff9b2f8 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 48799df7-5d7b-414b-bd2b-a318c43afd3e with Priority: HIGHEST for action port [ 822.238700] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_rules [ 822.238700] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_rules [ 822.238700] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 with Priority: HIGHEST for action security_group_members [ 822.238843] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48799df7-5d7b-414b-bd2b-a318c43afd3e with Priority: HIGHEST for action port [ 822.238878] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 with Priority: HIGHEST for action security_group_rules [ 822.238942] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 822.239135] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_members [ 822.387093] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.389677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.389677] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-592d30d0-26f8-4498-ae9a-adafe7d95eb3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.389677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.389677] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c444bda-b43d-4fc8-a3ca-afe327ac3279 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.389677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.389677] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-48799df7-5d7b-414b-bd2b-a318c43afd3e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.389677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.389677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.389677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.389677] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48799df7-5d7b-414b-bd2b-a318c43afd3e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.390569] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c444bda-b43d-4fc8-a3ca-afe327ac3279 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.390569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.390569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.390840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.390944] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c444bda-b43d-4fc8-a3ca-afe327ac3279',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.391775] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.391908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.392139] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-592d30d0-26f8-4498-ae9a-adafe7d95eb3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.392261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.555032] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.556169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.556169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.556169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.556169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.556169] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4a9da48-db34-4124-bc5a-acf3f884fbec already deleted. [ 822.556169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.556401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.557232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.557232] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.625326] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3aeeb294-14c6-4fb6-bbb6-67a12deabbef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.691600] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.692451] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c444bda-b43d-4fc8-a3ca-afe327ac3279',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.694917] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.695724] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.893549] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c444bda-b43d-4fc8-a3ca-afe327ac3279 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.893695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.893865] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48799df7-5d7b-414b-bd2b-a318c43afd3e with status ACTIVE [ 822.894038] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.894145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.894213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.894429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.894429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.894702] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.894762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.894824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.894976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.895066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.895248] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.895456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.895456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.895559] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.895589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.895665] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48799df7-5d7b-414b-bd2b-a318c43afd3e is going to be updated. [ 822.921885] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.921885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.921885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.921885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.921885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.921885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48799df7-5d7b-414b-bd2b-a318c43afd3e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.078622] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.078622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.078622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.078622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.079410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.079683] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4a9da48-db34-4124-bc5a-acf3f884fbec already deleted. [ 823.079884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.128878] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.129923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.129923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.129923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.129923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.129923] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef is going to be created. [ 823.187827] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.187827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.188076] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.188271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.188554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.194740] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.196203] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c444bda-b43d-4fc8-a3ca-afe327ac3279',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.196948] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.198094] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.201474] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef in Status: UNINITIALIZED for 2s [ 823.384882] env[69692]: INFO networking_nsxv3.common.synchronization [req-b5d152f5-d69a-48f9-988c-9dac00b08e6c req-2c0617f5-8526-402b-990b-ea7070b0e83f tempest-ServersWithSpecificFlavorTestJSON-467341840 tempest-ServersWithSpecificFlavorTestJSON-467341840-project-member] Enqueued Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_members [ 823.385282] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_members [ 823.385358] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.385475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.385537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.385734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.385874] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.385962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.387832] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.388289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.388404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.388504] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.428489] env[69692]: INFO networking_nsxv3.common.synchronization [None req-83e6697f-82cb-4225-b1c5-b338bc3ed1b4 None None] Enqueued Resource ID: dae8228c-8169-4004-bd26-4e216d9de165 with Priority: HIGHEST for action port [ 823.429251] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae8228c-8169-4004-bd26-4e216d9de165 with Priority: HIGHEST for action port [ 823.429559] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-dae8228c-8169-4004-bd26-4e216d9de165 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.429767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dae8228c-8169-4004-bd26-4e216d9de165" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.429767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dae8228c-8169-4004-bd26-4e216d9de165" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.430517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dae8228c-8169-4004-bd26-4e216d9de165" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.430618] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dae8228c-8169-4004-bd26-4e216d9de165',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.558191] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: SUCCESS [ 823.558577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.558647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.558807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.558896] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.596349] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 823.596349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.596349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.596349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.596349] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.703806] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.705334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.705391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.705612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.705708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.705820] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 is going to be updated. [ 823.707233] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.707359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.707426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.707633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.707726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.707824] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be updated. [ 823.711415] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.711551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.711619] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.711784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.711874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.711985] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 823.714508] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.718015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.718015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.718015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.718015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.718015] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 is going to be created. [ 823.748202] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.748350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.748420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.748731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.748927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.756172] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.756419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.756419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.756629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.757185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.758561] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.758649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.758714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.758871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.759921] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.761639] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.763578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.763578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.763578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.763578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.765553] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 in Status: UNINITIALIZED for 2s [ 823.767576] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.767769] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-460" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.767892] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-460" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.768158] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-460" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.769674] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.769674] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.769674] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.769674] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.769674] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.769674] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 823.769674] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.769674] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.769674] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.769674] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 823.770014] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.770014] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.793861] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 823.793861] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: IN_PROGRESS for 2s [ 823.793861] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 823.815088] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.815088] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 823.815088] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.815088] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-460" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.815088] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.815088] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.815088] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.815088] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.815088] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.890818] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.890992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.891559] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.891559] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.891559] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.891675] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.891732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.891908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.892029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.892029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.892533] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 is going to be deleted. [ 823.928014] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.928175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.928247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.928460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.928549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.928647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.936577] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dae8228c-8169-4004-bd26-4e216d9de165 [ 823.936577] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.936577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.936727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.936890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.936890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.938142] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dae8228c-8169-4004-bd26-4e216d9de165 already deleted. [ 823.938142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dae8228c-8169-4004-bd26-4e216d9de165" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.061161] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-592d30d0-26f8-4498-ae9a-adafe7d95eb3 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.061319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.096917] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.097081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.318991] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.319153] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.319202] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.319959] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.319959] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.319959] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5 not found, creating... [ 824.320117] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.320233] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.320363] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.320571] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.320701] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.321035] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.322237] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.322237] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.322237] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.322237] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.322237] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5 is going to be created. [ 824.345468] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.345708] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.345836] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.346133] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.346371] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.346596] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.571248] env[69692]: INFO networking_nsxv3.common.synchronization [req-8329e47b-339b-4625-98d2-f442a49169e7 req-027f0913-a6d1-46e7-8300-567afdfddf5d tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 824.571248] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 824.571248] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.572106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.572292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.572601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.572879] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.573261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.573609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.573902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.574102] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.574336] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.838180] env[69692]: INFO networking_nsxv3.common.synchronization [req-a15c93f2-87d0-4dd8-b1e7-61c1c5b472c5 req-04fb9032-0cea-4267-9f84-9edaa98a107c tempest-ServerAddressesTestJSON-345913374 tempest-ServerAddressesTestJSON-345913374-project-member] Enqueued Resource ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 with Priority: HIGHEST for action security_group_members [ 824.838464] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 with Priority: HIGHEST for action security_group_members [ 824.838773] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.838899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.839073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.839180] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.839340] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.839436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.839496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.839641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.839724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.839815] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8b96c18-8a3b-48f3-8303-8b48b5735ba8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.077231] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.077510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.077661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.081265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.081265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.081265] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.081265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.081265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.081265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.081265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.081265] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 825.106086] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.107776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.107776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.107776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.107776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.115992] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 825.210565] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef in Status: SUCCESS [ 825.211670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.211670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.211670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.211938] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.212207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.212271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.212515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.212654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.212792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.212946] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3aeeb294-14c6-4fb6-bbb6-67a12deabbef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.251140] env[69692]: INFO networking_nsxv3.common.synchronization [req-a7939e51-ea2f-412a-88c1-f2c4d59d438e req-f3dfd961-8b40-478f-b0fd-121d38b10731 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 with Priority: HIGHEST for action security_group_members [ 825.251140] env[69692]: INFO networking_nsxv3.common.synchronization [req-a7939e51-ea2f-412a-88c1-f2c4d59d438e req-f3dfd961-8b40-478f-b0fd-121d38b10731 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 825.251140] env[69692]: INFO networking_nsxv3.common.synchronization [req-a7939e51-ea2f-412a-88c1-f2c4d59d438e req-f3dfd961-8b40-478f-b0fd-121d38b10731 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_members [ 825.255436] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 with Priority: HIGHEST for action security_group_members [ 825.255436] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 825.255436] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 with Priority: HIGHEST for action security_group_members [ 825.256084] env[69692]: INFO networking_nsxv3.common.synchronization [req-b5d152f5-d69a-48f9-988c-9dac00b08e6c req-381f8e31-827c-44e6-b5f8-17211e92ac71 service nova] Enqueued Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_rules [ 825.256265] env[69692]: INFO networking_nsxv3.common.synchronization [req-b5d152f5-d69a-48f9-988c-9dac00b08e6c req-381f8e31-827c-44e6-b5f8-17211e92ac71 service nova] Enqueued Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_members [ 825.256400] env[69692]: INFO networking_nsxv3.common.synchronization [req-b5d152f5-d69a-48f9-988c-9dac00b08e6c req-381f8e31-827c-44e6-b5f8-17211e92ac71 service nova] Enqueued Resource ID: 5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5 with Priority: HIGHEST for action port [ 825.256731] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c444bda-b43d-4fc8-a3ca-afe327ac3279 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.256849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.257213] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.258286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.258576] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-592d30d0-26f8-4498-ae9a-adafe7d95eb3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.258691] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.259160] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_rules [ 825.259348] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_members [ 825.259697] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5 with Priority: HIGHEST for action port [ 825.261134] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.261314] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.264121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.264398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.264490] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.268013] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.268013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.268013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.268013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.268013] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.268013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.268013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.268013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.268013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.268013] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.268013] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.268013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.268013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.268529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.268529] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.345598] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.345945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.346123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.348962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.348962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.348962] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.348962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.348962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.348962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.348962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.348962] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 is going to be updated. [ 825.374499] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.374499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.374499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.374499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.374499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.385470] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 in Status: IN_PROGRESS for 2s [ 825.715971] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3aeeb294-14c6-4fb6-bbb6-67a12deabbef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.770238] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.770446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.773758] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.775063] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5 with status ACTIVE [ 825.779112] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.779112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.779112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.779112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.779112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.779112] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.779112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.779112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.779112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.779112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.779112] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.779112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.779112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.779112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.779112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.779112] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5 is going to be updated. [ 825.779112] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 in Status: SUCCESS [ 825.779702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.779702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.779702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.779702] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.779702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.779702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.779702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.779900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.779900] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c444bda-b43d-4fc8-a3ca-afe327ac3279',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.800804] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.800804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.800804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.800804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.800804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.800804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f6a5910-f8bf-4b32-92ce-1a8c5e03b2a5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.804763] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.804763] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.804763] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.804763] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.804763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.805561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.805561] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.810672] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: SUCCESS [ 825.811269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.811906] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 825.811906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.812204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.812726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.812726] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.812726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.812726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.812950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.812950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.813181] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.813801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.814014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.814169] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.815426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.815426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.815426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.815426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.815426] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.218434] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3aeeb294-14c6-4fb6-bbb6-67a12deabbef: rpc.has_security_group_logging(os_id): False [ 826.279416] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.282876] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.282876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.282876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.282876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.283185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.283185] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.283270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.283270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.283431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.283503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.283593] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 is going to be deleted. [ 826.315869] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.316075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.316075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.316303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.316394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.316587] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.316689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.317537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.317537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.317537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.317537] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 is going to be updated. [ 826.318281] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9: rpc.has_security_group_logging(os_id): False [ 826.319048] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.331642] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.331831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.331879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.332165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.332308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.332579] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.332757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.332824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.333206] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.333206] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.333206] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef is going to be created. [ 826.345029] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.345029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.345209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.345690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.345690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.345797] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.346419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.346494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.346668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.346751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.346964] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.347085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.347158] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.347304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.347388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.347578] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.347670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.347730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.347898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.347977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.348070] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be created. [ 826.365166] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.365305] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.365406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.365582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.366163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.367415] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.367551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.367644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.367835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.367924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.368041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.369576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.369746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.369905] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.370031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.370072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.370217] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.370296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.370386] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c444bda-b43d-4fc8-a3ca-afe327ac3279',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.379246] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: IN_PROGRESS for 2s [ 826.407718] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.407871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.408015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.408180] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.408359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.410590] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.410717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.410783] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.411225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.411430] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.433921] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 826.434660] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef in Status: IN_PROGRESS for 2s [ 826.787108] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.787542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.787542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.787803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.787945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.788104] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 is going to be created. [ 826.811301] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.811465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.811558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.811804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.812015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.820878] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 in Status: UNINITIALIZED for 2s [ 826.821126] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.872409] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.872565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.872608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.872829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.872921] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.873134] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.873227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.873292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.873457] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.873535] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.873620] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 already deleted. [ 826.873698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.873797] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c444bda-b43d-4fc8-a3ca-afe327ac3279',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.874774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.874850] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.874959] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.875088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.875153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.875307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.875383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.875477] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c444bda-b43d-4fc8-a3ca-afe327ac3279',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.125722] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 4s [ 827.323735] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.323735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.324278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.324278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.324278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.324278] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 827.358723] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.359060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.359222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.359512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.359767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.372473] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 827.377826] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c444bda-b43d-4fc8-a3ca-afe327ac3279',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.379339] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.379339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.379339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.379507] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.379591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.379766] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.380128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.380128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.380128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.380448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.380448] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 already deleted. [ 827.380448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.397288] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 in Status: SUCCESS [ 827.397288] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 deletion is rescheduled due to dependency. [ 827.397288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.610080] env[69692]: INFO networking_nsxv3.common.synchronization [req-e870ef16-240b-4d66-bb62-63ca603154d6 req-ef72df9b-cb91-42bb-811b-b4735d16c559 tempest-AttachInterfacesUnderV243Test-2039607704 tempest-AttachInterfacesUnderV243Test-2039607704-project-member] Enqueued Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 827.610217] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 827.610877] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.610877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.610877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.610877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.611247] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.611247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.611247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.611454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.611454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.611454] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.681365] env[69692]: INFO networking_nsxv3.common.synchronization [req-e870ef16-240b-4d66-bb62-63ca603154d6 req-ef72df9b-cb91-42bb-811b-b4735d16c559 tempest-AttachInterfacesUnderV243Test-2039607704 tempest-AttachInterfacesUnderV243Test-2039607704-project-member] Enqueued Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_rules [ 827.681365] env[69692]: INFO networking_nsxv3.common.synchronization [req-e870ef16-240b-4d66-bb62-63ca603154d6 req-ef72df9b-cb91-42bb-811b-b4735d16c559 tempest-AttachInterfacesUnderV243Test-2039607704 tempest-AttachInterfacesUnderV243Test-2039607704-project-member] Enqueued Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 827.681365] env[69692]: INFO networking_nsxv3.common.synchronization [req-e870ef16-240b-4d66-bb62-63ca603154d6 req-ef72df9b-cb91-42bb-811b-b4735d16c559 tempest-AttachInterfacesUnderV243Test-2039607704 tempest-AttachInterfacesUnderV243Test-2039607704-project-member] Enqueued Resource ID: d698553d-76ff-49bb-949a-c56b81bc55ca with Priority: HIGHEST for action port [ 827.681365] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_rules [ 827.681365] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 827.681365] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d698553d-76ff-49bb-949a-c56b81bc55ca with Priority: HIGHEST for action port [ 827.681365] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.681365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.681845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.682186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.682372] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.683490] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.683705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.684019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-d698553d-76ff-49bb-949a-c56b81bc55ca taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.684254] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.684407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.684662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.684881] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d698553d-76ff-49bb-949a-c56b81bc55ca',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.882230] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c444bda-b43d-4fc8-a3ca-afe327ac3279: rpc.has_security_group_logging(os_id): False [ 827.901327] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.901470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.901546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.901771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.901860] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.902125] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.902238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.902410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.902467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.902550] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.902693] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 is going to be created. [ 827.922123] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9c444bda-b43d-4fc8-a3ca-afe327ac3279], does not exist path=[/infra/domains/default/groups/9c444bda-b43d-4fc8-a3ca-afe327ac3279]."\n}' [ 827.922323] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9c444bda-b43d-4fc8-a3ca-afe327ac3279 [ 827.922490] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 827.960927] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.961319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.961421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.961631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.962706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.965797] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.966063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.966063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.966270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.966406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.966661] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.966779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.966843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.967023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.967092] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.967175] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c444bda-b43d-4fc8-a3ca-afe327ac3279 is going to be created. [ 827.999727] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9c444bda-b43d-4fc8-a3ca-afe327ac3279], does not exist path=[/infra/domains/default/groups/9c444bda-b43d-4fc8-a3ca-afe327ac3279]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9c444bda-b43d-4fc8-a3ca-afe327ac3279 [ 827.999810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c444bda-b43d-4fc8-a3ca-afe327ac3279" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.000413] env[69692]: Traceback (most recent call last): [ 828.000535] env[69692]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 828.000535] env[69692]: return func(*args, **kwargs) [ 828.000535] env[69692]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 828.000535] env[69692]: res.raise_for_status() [ 828.000535] env[69692]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 828.000535] env[69692]: raise HTTPError(http_error_msg, response=self) [ 828.000535] env[69692]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9c444bda-b43d-4fc8-a3ca-afe327ac3279 [ 828.000535] env[69692]: During handling of the above exception, another exception occurred: [ 828.000535] env[69692]: Traceback (most recent call last): [ 828.000535] env[69692]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 828.000535] env[69692]: listener.cb(fileno) [ 828.000535] env[69692]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 828.000535] env[69692]: result = function(*args, **kwargs) [ 828.000535] env[69692]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 828.000535] env[69692]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 828.000535] env[69692]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 828.000535] env[69692]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 828.000535] env[69692]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 828.000535] env[69692]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 828.000535] env[69692]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 828.000535] env[69692]: res.raise_for_status() [ 828.000535] env[69692]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 828.000535] env[69692]: raise HTTPError(http_error_msg, response=self) [ 828.000535] env[69692]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9c444bda-b43d-4fc8-a3ca-afe327ac3279 [ 828.000535] env[69692]: Removing descriptor: 72 [ 828.018321] env[69692]: INFO networking_nsxv3.common.synchronization [req-9a9fd0d2-0a88-495f-b70d-987cae79711b req-8f0af936-0f6a-4b97-9212-ccce7b4fb207 tempest-ServerDiskConfigTestJSON-756528476 tempest-ServerDiskConfigTestJSON-756528476-project-member] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 828.019024] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 828.019328] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.019505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.019602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.019831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.020085] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.020215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.020310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.020495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.020880] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.020880] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.114382] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.191042] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.191042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.191042] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d698553d-76ff-49bb-949a-c56b81bc55ca with status ACTIVE [ 828.191042] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.191042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.191042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.191042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.191042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.191042] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.191042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.191042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.191042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.191042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.191042] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.192010] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.192010] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.192010] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.192010] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.192010] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d698553d-76ff-49bb-949a-c56b81bc55ca is going to be updated. [ 828.207131] env[69692]: INFO networking_nsxv3.common.synchronization [req-b9345aac-bb20-432b-ab9f-ded60d495249 req-c2e80bea-e73c-4bc7-b2a3-73a3e07af246 tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGHEST for action security_group_members [ 828.207678] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGHEST for action security_group_members [ 828.208091] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-501c3651-4f53-4420-b2dc-d80ff25930b1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.208233] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.208302] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.208571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.208769] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.208901] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.208951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.209136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.209227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.209382] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.222877] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.223222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.223331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.223546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.223794] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.224017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.383669] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: SUCCESS [ 828.383785] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 deletion is rescheduled due to dependency. [ 828.383914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.384098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.385276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.385276] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.385276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.385276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.385419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.385510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.385641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.385742] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.386994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.387199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.387362] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.387529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.387596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.387746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.387825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.387936] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.447852] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef in Status: SUCCESS [ 828.447852] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.449190] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 828.449190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.449190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.449338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.449338] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.522638] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.522828] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.522918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.523183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.547668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.548013] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.548233] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.548333] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.548628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.548756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.548984] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 828.575940] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.575940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.575940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.575940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.575940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.597291] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 828.619366] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.711677] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.711859] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.711942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.712297] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.732496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.733012] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.733012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.733012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.733232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.733337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.733409] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 is going to be updated. [ 828.758886] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.760280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.760280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.760280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.760280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.768781] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 in Status: IN_PROGRESS for 2s [ 828.835684] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 in Status: SUCCESS [ 828.835684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.835684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.835684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.835684] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.835684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.835684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.835684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.835684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.835684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.835684] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.889806] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('592d30d0-26f8-4498-ae9a-adafe7d95eb3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.890889] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.891091] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.891190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.891427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.911963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.912145] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.912501] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.912501] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.912661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.912661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.912730] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 is going to be updated. [ 828.940772] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.940919] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.940984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.942032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.942032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.949961] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: IN_PROGRESS for 2s [ 828.954454] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.954699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.954753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.954952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.955137] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.955642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.955735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.955902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.955993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.956099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.956229] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.124714] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.124714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.124714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.124714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.124714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.124714] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 is going to be updated. [ 829.140543] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 829.140640] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b deletion is rescheduled due to dependency. [ 829.140677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.160054] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.160366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.160451] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.160698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.160844] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.168387] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: IN_PROGRESS for 2s [ 829.341860] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.381772] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 829.382636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.383020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.383629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.384356] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.384356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.384356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.384497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.384655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.384817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.384992] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.385995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.386538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.390254] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.390389] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.390456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.390624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.390712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.390824] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.394716] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 592d30d0-26f8-4498-ae9a-adafe7d95eb3: rpc.has_security_group_logging(os_id): False [ 829.412568] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.412714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.412785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.412992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.413099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.413328] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.413446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.413512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.413668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.413743] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.413828] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 is going to be updated. [ 829.460659] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.461042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.461042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.461326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.461402] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.461497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.461574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.461763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.461859] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.461961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.462159] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.462275] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.462363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.462546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.462767] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.462886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.462956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.463695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.463967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.464177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.464308] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.481878] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.482181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.482333] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.482635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.482895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.504896] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: IN_PROGRESS for 2s [ 829.847102] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcf8de7e-6145-413a-bbc2-af3db93cdf58: rpc.has_security_group_logging(os_id): False [ 829.870571] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.870810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.870922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.871262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.871418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.871710] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.871863] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.871978] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.872231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.872954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.877020] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 is going to be created. [ 829.892494] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.892853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.894991] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.901182] env[69692]: INFO networking_nsxv3.common.synchronization [req-7fe00681-c2b3-48d5-9783-90afb518b2d0 req-66a00f10-8f4b-47d4-af19-72a834ac1d66 tempest-MultipleCreateTestJSON-73038672 tempest-MultipleCreateTestJSON-73038672-project-member] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 829.901713] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 829.902077] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.903726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.903868] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.904228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.904458] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.904845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.904845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.904845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.905046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.905187] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.929611] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.929754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.929831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.930062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.930246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.944538] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 in Status: IN_PROGRESS for 2s [ 829.967935] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9: rpc.has_security_group_logging(os_id): False [ 829.996461] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.996621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.996692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.996901] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.019901] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.020704] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.020888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.021077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.021309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.021405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.021606] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.021712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.021778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.021926] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.022015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.022213] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.022304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.022361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.022499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.022574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.022658] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be updated. [ 830.109466] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.109577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.110047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.110047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.110047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.122338] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 830.308594] env[69692]: INFO networking_nsxv3.common.synchronization [req-fe2c6ff0-4f20-4952-b829-6cb9cbd651bd req-b276af0e-cb64-40f6-92f5-5f84c5c9e952 tempest-MultipleCreateTestJSON-73038672 tempest-MultipleCreateTestJSON-73038672-project-member] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 830.310048] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 830.310623] env[69692]: INFO networking_nsxv3.common.synchronization [req-e7fa54a8-6e70-42ab-90ad-63dca0532176 req-ec1f5ffb-89b4-441e-9360-0ae194549b81 tempest-VolumesAdminNegativeTest-1078272547 tempest-VolumesAdminNegativeTest-1078272547-project-member] Enqueued Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGHEST for action security_group_members [ 830.310948] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.311101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.316369] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGHEST for action security_group_members [ 830.317280] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0606438c-ea63-4fae-97b5-53d1cd997a59 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.318141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.318141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.318141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.318141] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.318141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.318141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.318141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.318991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.322901] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.400749] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.407965] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.607614] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 830.607722] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 deletion is rescheduled due to dependency. [ 830.607932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.778702] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 in Status: SUCCESS [ 830.778850] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 deletion is rescheduled due to dependency. [ 830.778977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.783813] env[69692]: INFO networking_nsxv3.common.synchronization [req-a71c50bc-214b-4105-ba34-22b167f512cf req-9de24255-a556-4c63-a8cc-f722ac1d2159 tempest-AttachInterfacesUnderV243Test-2039607704 tempest-AttachInterfacesUnderV243Test-2039607704-project-member] Enqueued Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 830.783990] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 830.784366] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.784483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.813632] env[69692]: INFO networking_nsxv3.common.synchronization [req-a71c50bc-214b-4105-ba34-22b167f512cf req-9de24255-a556-4c63-a8cc-f722ac1d2159 tempest-AttachInterfacesUnderV243Test-2039607704 tempest-AttachInterfacesUnderV243Test-2039607704-project-member] Enqueued Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_rules [ 830.813829] env[69692]: INFO networking_nsxv3.common.synchronization [req-a71c50bc-214b-4105-ba34-22b167f512cf req-9de24255-a556-4c63-a8cc-f722ac1d2159 tempest-AttachInterfacesUnderV243Test-2039607704 tempest-AttachInterfacesUnderV243Test-2039607704-project-member] Enqueued Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 830.813977] env[69692]: INFO networking_nsxv3.common.synchronization [req-a71c50bc-214b-4105-ba34-22b167f512cf req-9de24255-a556-4c63-a8cc-f722ac1d2159 tempest-AttachInterfacesUnderV243Test-2039607704 tempest-AttachInterfacesUnderV243Test-2039607704-project-member] Enqueued Resource ID: d698553d-76ff-49bb-949a-c56b81bc55ca with Priority: HIGHEST for action port [ 830.814541] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_rules [ 830.814686] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 830.814774] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d698553d-76ff-49bb-949a-c56b81bc55ca with Priority: HIGHEST for action port [ 830.815064] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.815188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.815393] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.815577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.815724] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-d698553d-76ff-49bb-949a-c56b81bc55ca taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.815766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.815906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.816037] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.816179] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d698553d-76ff-49bb-949a-c56b81bc55ca',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.822294] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.825441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.825441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.825441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.844136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.844467] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.844562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.844632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.844830] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.844914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.845009] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 is going to be updated. [ 830.871341] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.873087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.873087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.873087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.873087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.883356] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 in Status: IN_PROGRESS for 2s [ 830.903338] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.903739] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.903739] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.904015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.904015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.904015] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 830.910999] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.931284] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.931466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.931572] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.932426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.932426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.945489] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 830.959825] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: SUCCESS [ 830.960098] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 deletion is rescheduled due to dependency. [ 830.960216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.179786] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: SUCCESS [ 831.179928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.180643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.180643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.180643] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.180822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.180822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.180961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.181082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.181198] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.319882] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d698553d-76ff-49bb-949a-c56b81bc55ca with status ACTIVE [ 831.320032] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.320166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.320229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.322101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.322101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.322101] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.322101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.322101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.322101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.322101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.322101] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.322101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.323935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.323935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.323935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.323935] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d698553d-76ff-49bb-949a-c56b81bc55ca is going to be updated. [ 831.341780] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.343385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.343385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.343385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.343385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.343599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d698553d-76ff-49bb-949a-c56b81bc55ca" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.372844] env[69692]: INFO networking_nsxv3.common.synchronization [req-e439eae8-8cd2-4c92-99be-27ea60d952d3 req-19a170c8-bb0e-4dbe-86cb-30d956f6bbc2 tempest-ServerActionsTestJSON-532161054 tempest-ServerActionsTestJSON-532161054-project-member] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 831.373406] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 831.373717] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.373836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.373900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.375382] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.375548] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.375654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.375718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.375889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.375956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.376074] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.413441] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.413653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.413653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.413872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.413958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.414075] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be updated. [ 831.451632] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.451812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.451905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.452203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.452386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.468666] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 831.529241] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 592d30d0-26f8-4498-ae9a-adafe7d95eb3 in Status: SUCCESS [ 831.532026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-592d30d0-26f8-4498-ae9a-adafe7d95eb3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.689544] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.882427] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.882603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.882663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.882884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.882974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.883721] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.883721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.883721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.883721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.883721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.883721] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 already deleted. [ 831.884153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.958036] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 in Status: SUCCESS [ 831.958310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.068143] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.068448] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.068605] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.068967] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.069287] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.069476] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.069640] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.070062] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.070273] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.070595] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.070805] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.071053] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.071205] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.071338] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.071481] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.071683] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.089417] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.089623] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 832.089770] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.089950] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.090288] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-4fdb835d-6532-41ed-a080-cc51c855a95e taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.090466] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-4fdb835d-6532-41ed-a080-cc51c855a95e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.090598] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-4fdb835d-6532-41ed-a080-cc51c855a95e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.090937] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-4fdb835d-6532-41ed-a080-cc51c855a95e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.091152] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fdb835d-6532-41ed-a080-cc51c855a95e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.134233] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 832.134534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.191611] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.593295] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.593622] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.593765] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.594239] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.594442] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.594759] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 4fdb835d-6532-41ed-a080-cc51c855a95e not found, creating... [ 832.594986] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.595249] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.595379] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.596186] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.596186] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.596385] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.596448] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.596702] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.596866] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.597015] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.597189] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 4fdb835d-6532-41ed-a080-cc51c855a95e is going to be created. [ 832.615733] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.616023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.616216] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.616584] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.616851] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.617150] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-4fdb835d-6532-41ed-a080-cc51c855a95e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.696920] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.700561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.700682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.700948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.701080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.701195] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 is going to be updated. [ 832.734712] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.734712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.734712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.734973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.735506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.748771] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: IN_PROGRESS for 2s [ 832.848557] env[69692]: INFO networking_nsxv3.common.synchronization [None req-2c54a9a6-ce06-4d6a-ac4d-1c68b2398047 None None] Enqueued Resource ID: 3b935cf3-8328-4ed5-8308-be3df0eb4183 with Priority: HIGHEST for action port [ 832.849177] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b935cf3-8328-4ed5-8308-be3df0eb4183 with Priority: HIGHEST for action port [ 832.849553] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b935cf3-8328-4ed5-8308-be3df0eb4183 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.849691] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b935cf3-8328-4ed5-8308-be3df0eb4183" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.849762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b935cf3-8328-4ed5-8308-be3df0eb4183" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.853528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b935cf3-8328-4ed5-8308-be3df0eb4183" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.853675] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b935cf3-8328-4ed5-8308-be3df0eb4183',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.894023] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 in Status: SUCCESS [ 832.894023] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 deletion is rescheduled due to dependency. [ 832.894023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.955704] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 832.955704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.955704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.956380] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.956380] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.956527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.956561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.956731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.956978] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.957365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.957365] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.957477] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.957477] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.958353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.958353] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.958353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.958353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.958353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.958353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.958353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.958353] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.356935] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b935cf3-8328-4ed5-8308-be3df0eb4183 [ 833.357262] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.357404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.357485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.357707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.357799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.357895] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b935cf3-8328-4ed5-8308-be3df0eb4183 already deleted. [ 833.357974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b935cf3-8328-4ed5-8308-be3df0eb4183" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.460636] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c88a973-e953-4cb7-bda1-829fc68b91a4: rpc.has_security_group_logging(os_id): False [ 833.476388] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 833.476622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.477578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.477998] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.478103] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.478174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.478220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.478372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.478991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.478991] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.480191] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.480273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.480333] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.480567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.501396] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.503640] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.503826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.504089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.504768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.504768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.504768] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.504768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.504768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.505065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.505065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.505186] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.505269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.505328] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.505463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.505534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.505615] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 833.580843] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.580843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.580843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.581024] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.581225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.603757] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 833.700495] env[69692]: INFO networking_nsxv3.common.synchronization [req-e439eae8-8cd2-4c92-99be-27ea60d952d3 req-a0549fcc-23f1-4ab0-abce-817eedadb5be service nova] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_rules [ 833.700730] env[69692]: INFO networking_nsxv3.common.synchronization [req-e439eae8-8cd2-4c92-99be-27ea60d952d3 req-a0549fcc-23f1-4ab0-abce-817eedadb5be service nova] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 833.700876] env[69692]: INFO networking_nsxv3.common.synchronization [req-e439eae8-8cd2-4c92-99be-27ea60d952d3 req-a0549fcc-23f1-4ab0-abce-817eedadb5be service nova] Enqueued Resource ID: 4fdb835d-6532-41ed-a080-cc51c855a95e with Priority: HIGHEST for action port [ 833.701495] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_rules [ 833.701656] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 833.701768] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fdb835d-6532-41ed-a080-cc51c855a95e with Priority: HIGHEST for action port [ 833.705817] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.705973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.706058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.706318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.706396] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.707443] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.707622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.707707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.707950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.708139] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.708242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.708304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.708459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.708636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.708636] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.715414] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fdb835d-6532-41ed-a080-cc51c855a95e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.715585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fdb835d-6532-41ed-a080-cc51c855a95e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.715625] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fdb835d-6532-41ed-a080-cc51c855a95e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.715892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fdb835d-6532-41ed-a080-cc51c855a95e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.715956] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fdb835d-6532-41ed-a080-cc51c855a95e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.985762] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.986039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.986039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.986247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.986339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.986544] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.986644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.986706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.986896] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.986929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.987032] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be updated. [ 834.017138] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.017450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.017450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.018516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.018516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.027157] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 834.219370] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.219370] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.219370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.219370] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4fdb835d-6532-41ed-a080-cc51c855a95e with status ACTIVE [ 834.219370] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.219597] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.219597] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.219728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.220651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.220651] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.220651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.220651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.220651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.220651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.221051] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.221201] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.221336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.221518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.221518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.221593] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4fdb835d-6532-41ed-a080-cc51c855a95e is going to be updated. [ 834.244407] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.244407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.244407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.244852] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.244852] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.244852] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fdb835d-6532-41ed-a080-cc51c855a95e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.724213] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.759935] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: SUCCESS [ 834.759986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.760220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.760487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.760615] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.760734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.760908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.761183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.761183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.761183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.761345] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.762365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.762548] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.762711] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.762815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.762874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.763053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.763135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.763413] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.230144] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.230415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.230415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.230614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.230738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.230836] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 is going to be created. [ 835.253814] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.253990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.254044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.254510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.254510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.263354] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: UNINITIALIZED for 2s [ 835.264979] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.268015] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.595059] env[69692]: INFO networking_nsxv3.common.synchronization [None req-66009200-ee09-41b3-896a-5d2b6e3076a4 None None] Enqueued Resource ID: d8b1af48-0c62-401c-b821-70063eb4c63c with Priority: HIGHEST for action port [ 835.595059] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8b1af48-0c62-401c-b821-70063eb4c63c with Priority: HIGHEST for action port [ 835.595265] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8b1af48-0c62-401c-b821-70063eb4c63c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.595265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8b1af48-0c62-401c-b821-70063eb4c63c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.595954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8b1af48-0c62-401c-b821-70063eb4c63c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.595954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8b1af48-0c62-401c-b821-70063eb4c63c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.595954] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8b1af48-0c62-401c-b821-70063eb4c63c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.619504] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 835.619738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.770332] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66714054-d28c-49d2-8bed-8ed704c74fc1: rpc.has_security_group_logging(os_id): False [ 835.771699] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.791399] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.791534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.791587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.791770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.811179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.811510] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.811635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.811703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.812054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.812054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.812145] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 is going to be updated. [ 835.876309] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.876309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.876309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.876482] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.876522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.892399] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: IN_PROGRESS for 2s [ 835.952812] env[69692]: INFO networking_nsxv3.common.synchronization [req-bf2532bb-8130-46d8-80a2-bb740bef67fb req-93babedd-c58a-48ca-96fe-b7ef37639452 tempest-AttachInterfacesUnderV243Test-2039607704 tempest-AttachInterfacesUnderV243Test-2039607704-project-member] Enqueued Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 835.953097] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 with Priority: HIGHEST for action security_group_members [ 835.953173] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-66714054-d28c-49d2-8bed-8ed704c74fc1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.953281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.037692] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 836.037765] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 deletion is rescheduled due to dependency. [ 836.037866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.099037] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8b1af48-0c62-401c-b821-70063eb4c63c [ 836.099285] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.099432] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.099508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.099732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.099823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.100244] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8b1af48-0c62-401c-b821-70063eb4c63c already deleted. [ 836.100244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8b1af48-0c62-401c-b821-70063eb4c63c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.276090] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.276662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.276662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.276662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.276662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.276962] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 is going to be updated. [ 836.302918] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.302918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.302918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.302918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.303239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.318024] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: IN_PROGRESS for 2s [ 836.970564] env[69692]: INFO networking_nsxv3.common.synchronization [req-d5d85d60-1e4e-490a-af3a-de2d1f1b8c48 req-b5f70096-c89d-4061-8d77-02720c7e8a14 tempest-AttachVolumeTestJSON-1369618715 tempest-AttachVolumeTestJSON-1369618715-project-member] Enqueued Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGHEST for action security_group_members [ 836.971195] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGHEST for action security_group_members [ 836.971516] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.971635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.971700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.971988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.974571] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.974768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.974885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.975159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.975249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.975349] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.280022] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: SUCCESS [ 837.280022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.280022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.280022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.280022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.280022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.280022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.280022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.280022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.280022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.280022] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.437263] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.437263] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-496" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.437263] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-496" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.437263] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-496" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.437263] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.437263] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.437263] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.437263] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.437263] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.437263] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.437263] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.437263] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.437263] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.439489] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.440163] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.443138] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.461921] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.462115] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 837.462235] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.462448] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-496" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.462767] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-dfcc2628-667d-4580-8403-28526c397749 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.462948] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-dfcc2628-667d-4580-8403-28526c397749" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.463083] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-dfcc2628-667d-4580-8403-28526c397749" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.463494] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-dfcc2628-667d-4580-8403-28526c397749" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.463612] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfcc2628-667d-4580-8403-28526c397749',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.478116] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.478773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.478773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.478773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.478773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.479185] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.479185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.479185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.479300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.479329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.479532] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 already deleted. [ 837.479532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.784105] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.910226] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: SUCCESS [ 837.910681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.912058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.912058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.912058] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.976026] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.976026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.976026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.976026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.976026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.976026] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port dfcc2628-667d-4580-8403-28526c397749 not found, creating... [ 837.976026] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.976026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.976026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.976026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.976026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.976514] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.976514] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.976514] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.976514] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.976514] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.976896] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: dfcc2628-667d-4580-8403-28526c397749 is going to be created. [ 837.998575] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.998898] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.999089] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.999419] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.999768] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.000239] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-dfcc2628-667d-4580-8403-28526c397749" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.287010] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c27a619-83e9-4ab1-a7c8-d2d45bd50134: rpc.has_security_group_logging(os_id): False [ 838.306375] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.306718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.306718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.306888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.306960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.307222] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.307322] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.307388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.307549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.307646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.307707] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 is going to be created. [ 838.329903] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 in Status: SUCCESS [ 838.330180] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.331755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.331755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.331755] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.331755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.331755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.331755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.331755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.331755] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.376968] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.377164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.377240] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.377470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.377656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.391109] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: IN_PROGRESS for 2s [ 838.441685] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.442048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.442048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.442303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.442443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.442585] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 is going to be deleted. [ 838.523323] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.523323] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.523323] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.523323] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.523570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.523604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.770265] env[69692]: INFO networking_nsxv3.common.synchronization [None req-3f2c7232-36f8-45e5-9277-48e86fbfc0f7 None None] Enqueued Resource ID: b2e18354-3ee6-4fc7-ad3f-f8b8d8484d36 with Priority: HIGHEST for action port [ 838.770537] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2e18354-3ee6-4fc7-ad3f-f8b8d8484d36 with Priority: HIGHEST for action port [ 838.771139] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2e18354-3ee6-4fc7-ad3f-f8b8d8484d36 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.771262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2e18354-3ee6-4fc7-ad3f-f8b8d8484d36" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.771345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2e18354-3ee6-4fc7-ad3f-f8b8d8484d36" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.771569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2e18354-3ee6-4fc7-ad3f-f8b8d8484d36" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.771655] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2e18354-3ee6-4fc7-ad3f-f8b8d8484d36',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.834704] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.834704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.834704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.834858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.834968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.835294] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.835294] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.835425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.836023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.836023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.836023] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 is going to be deleted. [ 838.838322] env[69692]: INFO networking_nsxv3.common.synchronization [req-d5d85d60-1e4e-490a-af3a-de2d1f1b8c48 req-a447b1d5-8461-4bb0-afcb-a48d9a375d88 service nova] Enqueued Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGHEST for action security_group_rules [ 838.838322] env[69692]: INFO networking_nsxv3.common.synchronization [req-d5d85d60-1e4e-490a-af3a-de2d1f1b8c48 req-a447b1d5-8461-4bb0-afcb-a48d9a375d88 service nova] Enqueued Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGHEST for action security_group_members [ 838.838322] env[69692]: INFO networking_nsxv3.common.synchronization [req-d5d85d60-1e4e-490a-af3a-de2d1f1b8c48 req-a447b1d5-8461-4bb0-afcb-a48d9a375d88 service nova] Enqueued Resource ID: dfcc2628-667d-4580-8403-28526c397749 with Priority: HIGHEST for action port [ 838.839017] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGHEST for action security_group_rules [ 838.839956] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGHEST for action security_group_members [ 838.839956] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfcc2628-667d-4580-8403-28526c397749 with Priority: HIGHEST for action port [ 838.846301] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.846301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.846301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.846301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.846301] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.846301] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.846301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.846301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.846301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.846301] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.846301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.846301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.848318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.848318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.848318] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.855644] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfcc2628-667d-4580-8403-28526c397749 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.855644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfcc2628-667d-4580-8403-28526c397749" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.855644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfcc2628-667d-4580-8403-28526c397749" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.855644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfcc2628-667d-4580-8403-28526c397749" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.855644] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfcc2628-667d-4580-8403-28526c397749',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.869126] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.869126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.869260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.869396] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.870241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.870241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.870442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.870645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.870812] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.870908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.870969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.871268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.871268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.871416] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66714054-d28c-49d2-8bed-8ed704c74fc1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.277416] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2e18354-3ee6-4fc7-ad3f-f8b8d8484d36 [ 839.277659] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.277790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.277860] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.278105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.278198] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.278291] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2e18354-3ee6-4fc7-ad3f-f8b8d8484d36 already deleted. [ 839.278410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2e18354-3ee6-4fc7-ad3f-f8b8d8484d36" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.355117] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.358111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.358111] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.358111] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfcc2628-667d-4580-8403-28526c397749 with status ACTIVE [ 839.358111] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.358111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.358111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.358111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.358111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.358111] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.358111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.358111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.358111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.358111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.360362] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.360362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.360362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.360362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.360362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.360362] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfcc2628-667d-4580-8403-28526c397749 is going to be updated. [ 839.377021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.377230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.377676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.377676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.377676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.377894] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.377976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.378041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.378366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.378366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.378366] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66714054-d28c-49d2-8bed-8ed704c74fc1 already deleted. [ 839.378649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66714054-d28c-49d2-8bed-8ed704c74fc1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.379515] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.379673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.379722] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.379857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.379987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.380173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfcc2628-667d-4580-8403-28526c397749" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.835552] env[69692]: INFO networking_nsxv3.common.synchronization [None req-f2f772f6-da45-41d3-b8ff-d0c9a6690375 tempest-ServerActionsV293TestJSON-586801738 tempest-ServerActionsV293TestJSON-586801738-project-member] Enqueued Resource ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a with Priority: HIGHEST for action security_group_rules [ 839.835552] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a with Priority: HIGHEST for action security_group_rules [ 839.835552] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.835552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.835552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.835765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.835800] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.862091] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.968456] env[69692]: INFO networking_nsxv3.common.synchronization [None req-16e92656-ae18-41a1-8988-721e3fb63539 tempest-ServerActionsV293TestJSON-586801738 tempest-ServerActionsV293TestJSON-586801738-project-member] Enqueued Resource ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a with Priority: HIGHEST for action security_group_rules [ 839.969466] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a with Priority: HIGHEST for action security_group_rules [ 839.970045] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.970045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.362583] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.362883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.362883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.363018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.363113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.363288] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a already deleted. [ 840.363288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.364150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.364150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.364150] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.366626] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.366626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.366741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.366934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.367096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.367241] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 is going to be created. [ 840.398866] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.398866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.399044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.399203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.399373] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.402568] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: SUCCESS [ 840.402841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.407832] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 in Status: UNINITIALIZED for 2s [ 840.631463] env[69692]: INFO networking_nsxv3.common.synchronization [None req-73bd6084-a45f-463d-9956-e5db8e425f7c None None] Enqueued Resource ID: cc26cc4f-adda-4c12-9495-3458e4a2e537 with Priority: HIGHEST for action port [ 840.631463] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc26cc4f-adda-4c12-9495-3458e4a2e537 with Priority: HIGHEST for action port [ 840.631463] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc26cc4f-adda-4c12-9495-3458e4a2e537 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.631598] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc26cc4f-adda-4c12-9495-3458e4a2e537" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.631598] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc26cc4f-adda-4c12-9495-3458e4a2e537" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.631801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc26cc4f-adda-4c12-9495-3458e4a2e537" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.631877] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc26cc4f-adda-4c12-9495-3458e4a2e537',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.885989] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.885989] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.885989] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.885989] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.885989] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.885989] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a already deleted. [ 840.885989] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.138363] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc26cc4f-adda-4c12-9495-3458e4a2e537 [ 841.138616] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.138755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.138841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.139221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.139263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.139403] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc26cc4f-adda-4c12-9495-3458e4a2e537 already deleted. [ 841.139523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc26cc4f-adda-4c12-9495-3458e4a2e537" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.424618] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 in Status: SUCCESS [ 842.425109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.425109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.425249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.425405] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.425528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.425571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.425727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.425805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.425887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.426017] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.605922] env[69692]: INFO networking_nsxv3.common.synchronization [req-4b8c5ef3-e6ef-443e-9586-9cacc2726324 req-8d808a38-e674-469a-84aa-6a728b61c1e4 tempest-ListServerFiltersTestJSON-797986437 tempest-ListServerFiltersTestJSON-797986437-project-member] Enqueued Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 842.605922] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 842.606632] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.606903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.607080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.608982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.608982] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.608982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.608982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.608982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.608982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.608982] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.764501] env[69692]: INFO networking_nsxv3.common.synchronization [req-d3842e49-b1bc-47f5-9768-aa2a92c4d9b5 req-9d9b5b9f-73a8-426d-b4f9-44b41588e6e4 tempest-ServerRescueNegativeTestJSON-8223595 tempest-ServerRescueNegativeTestJSON-8223595-project-member] Enqueued Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_members [ 842.765014] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_members [ 842.765498] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.765619] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.765689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.766251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.766251] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.766390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.766390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.766529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.766614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.766884] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.927706] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.110492] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.269019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.269236] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.269314] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.269540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.269674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.269885] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.269983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.270048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.270210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.270290] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.270376] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9debc847-a741-46fa-9447-b1070c70a885 already deleted. [ 843.270458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.432281] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6: rpc.has_security_group_logging(os_id): False [ 843.446698] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.446698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.446698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.446936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.446970] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.448029] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.448029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.448029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.448029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.448029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.448029] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 is going to be created. [ 843.492205] env[69692]: INFO networking_nsxv3.common.synchronization [req-3f763f5e-7796-4775-ac0b-2f9b3a88dbc1 req-5235627e-9fef-4e3c-b260-d02771e920f4 tempest-ServersTestBootFromVolume-1974867416 tempest-ServersTestBootFromVolume-1974867416-project-member] Enqueued Resource ID: 7ae9a71f-5c96-43e4-8524-e661508c021c with Priority: HIGHEST for action security_group_members [ 843.492919] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ae9a71f-5c96-43e4-8524-e661508c021c with Priority: HIGHEST for action security_group_members [ 843.494033] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ae9a71f-5c96-43e4-8524-e661508c021c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.494033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.494174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.494351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.494521] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.494642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.494704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.494853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.494932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.495030] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ae9a71f-5c96-43e4-8524-e661508c021c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.510330] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.510643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.510726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.510969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.511223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.523049] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 in Status: IN_PROGRESS for 2s [ 843.614513] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.732804] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.733024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-328" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.733156] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-328" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.733523] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-328" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.733845] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.733955] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.737506] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.737506] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.737506] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.737506] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.737506] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.737506] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.737506] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.737506] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.738188] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.738188] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.756577] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.756761] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 843.756957] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.757171] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-328" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.757514] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-a395ed2f-f5da-4552-8984-21814e0ae104 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.757693] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-a395ed2f-f5da-4552-8984-21814e0ae104" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.757812] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-a395ed2f-f5da-4552-8984-21814e0ae104" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.758177] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-a395ed2f-f5da-4552-8984-21814e0ae104" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.758321] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a395ed2f-f5da-4552-8984-21814e0ae104',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.997866] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.998047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.998124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.998344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.017761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.018090] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.018249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.018327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.018530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.018616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.018706] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ae9a71f-5c96-43e4-8524-e661508c021c is going to be updated. [ 844.040991] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.041212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.041287] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.041500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.041640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.049524] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ae9a71f-5c96-43e4-8524-e661508c021c in Status: IN_PROGRESS for 2s [ 844.123126] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.123126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.123126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.123352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.123390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.123469] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 is going to be updated. [ 844.155031] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.155187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.155255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.155455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.155596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.163250] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: IN_PROGRESS for 2s [ 844.261471] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.261704] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.261836] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.262184] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.262424] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.262620] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port a395ed2f-f5da-4552-8984-21814e0ae104 not found, creating... [ 844.262920] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.263134] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.263286] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.263564] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.263732] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.264061] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.264281] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.264638] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.264638] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.264804] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.264973] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: a395ed2f-f5da-4552-8984-21814e0ae104 is going to be created. [ 844.283923] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.284184] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.284340] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.284614] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.284841] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.285077] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-a395ed2f-f5da-4552-8984-21814e0ae104" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.055880] env[69692]: INFO networking_nsxv3.common.synchronization [req-d3842e49-b1bc-47f5-9768-aa2a92c4d9b5 req-b8e42bd7-554b-4186-9738-6f33dac27396 service nova] Enqueued Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_rules [ 845.056176] env[69692]: INFO networking_nsxv3.common.synchronization [req-d3842e49-b1bc-47f5-9768-aa2a92c4d9b5 req-b8e42bd7-554b-4186-9738-6f33dac27396 service nova] Enqueued Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_members [ 845.056701] env[69692]: INFO networking_nsxv3.common.synchronization [req-d3842e49-b1bc-47f5-9768-aa2a92c4d9b5 req-b8e42bd7-554b-4186-9738-6f33dac27396 service nova] Enqueued Resource ID: a395ed2f-f5da-4552-8984-21814e0ae104 with Priority: HIGHEST for action port [ 845.056701] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_rules [ 845.056701] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_members [ 845.056701] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a395ed2f-f5da-4552-8984-21814e0ae104 with Priority: HIGHEST for action port [ 845.057241] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.057372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.057445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.057731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.057788] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.061300] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.061429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.061499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.061649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.061821] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.061917] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.063164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.063164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.063164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.063164] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.063164] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-a395ed2f-f5da-4552-8984-21814e0ae104 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.063164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a395ed2f-f5da-4552-8984-21814e0ae104" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.064095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a395ed2f-f5da-4552-8984-21814e0ae104" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.064095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a395ed2f-f5da-4552-8984-21814e0ae104" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.064095] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a395ed2f-f5da-4552-8984-21814e0ae104',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.534590] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 in Status: SUCCESS [ 845.534878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.567056] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.567244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.570562] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.572082] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a395ed2f-f5da-4552-8984-21814e0ae104 with status ACTIVE [ 845.572082] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.572082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.572082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.572291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.572291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.572375] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.572477] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.572538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.572692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.572768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.572949] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.573052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.573114] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.573256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.573330] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.573467] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a395ed2f-f5da-4552-8984-21814e0ae104 is going to be updated. [ 845.592827] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.592827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.592827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.592827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.593078] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.593078] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a395ed2f-f5da-4552-8984-21814e0ae104" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.059378] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ae9a71f-5c96-43e4-8524-e661508c021c in Status: SUCCESS [ 846.059650] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ae9a71f-5c96-43e4-8524-e661508c021c deletion is rescheduled due to dependency. [ 846.059692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ae9a71f-5c96-43e4-8524-e661508c021c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.081203] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.174372] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: SUCCESS [ 846.174372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.581306] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.581495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.581535] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.581862] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.581975] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.582122] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9debc847-a741-46fa-9447-b1070c70a885 is going to be created. [ 846.616873] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.617054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.617147] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.617451] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.617703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.635991] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: UNINITIALIZED for 2s [ 848.367109] env[69692]: INFO networking_nsxv3.common.synchronization [req-b578c96f-ca1b-4557-9ccf-a7d27532384e req-366193c3-c9d1-435f-8d14-8deb508c078d tempest-ServerRescueNegativeTestJSON-8223595 tempest-ServerRescueNegativeTestJSON-8223595-project-member] Enqueued Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_members [ 848.367109] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_members [ 848.367109] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.367109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.646568] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: SUCCESS [ 848.646836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.647058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.647322] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.647555] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.647667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.647747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.647916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.651021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.651021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.651021] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.651021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.651021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.651021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.651021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.651021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.651021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.651021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.651021] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.735381] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.735704] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-328" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.735885] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-328" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.736255] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-328" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.736614] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.736845] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.737023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.737425] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.737533] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.737815] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.737990] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.738188] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.738346] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.738503] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.738662] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.738868] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.757919] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.757919] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 848.758132] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.758280] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-328" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.758595] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-7ad9eae0-ba43-4dd1-a38c-756950552a19 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.758790] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-7ad9eae0-ba43-4dd1-a38c-756950552a19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.758910] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-7ad9eae0-ba43-4dd1-a38c-756950552a19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.759269] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-7ad9eae0-ba43-4dd1-a38c-756950552a19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.759423] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ad9eae0-ba43-4dd1-a38c-756950552a19',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.154390] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.156360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.156360] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.263110] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.263110] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.263110] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.263110] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.263110] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.263110] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 7ad9eae0-ba43-4dd1-a38c-756950552a19 not found, creating... [ 849.263453] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.263608] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.263728] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.263965] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.264152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.264478] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.264642] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.264763] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.264982] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.265147] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.265295] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 7ad9eae0-ba43-4dd1-a38c-756950552a19 is going to be created. [ 849.285623] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.285850] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.285979] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.286286] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.286779] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.286779] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-7ad9eae0-ba43-4dd1-a38c-756950552a19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.658026] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.001782] env[69692]: INFO networking_nsxv3.common.synchronization [req-b578c96f-ca1b-4557-9ccf-a7d27532384e req-b8b601be-d5af-4081-942a-29f4962dd9a6 service nova] Enqueued Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_rules [ 850.002291] env[69692]: INFO networking_nsxv3.common.synchronization [req-b578c96f-ca1b-4557-9ccf-a7d27532384e req-b8b601be-d5af-4081-942a-29f4962dd9a6 service nova] Enqueued Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_members [ 850.002291] env[69692]: INFO networking_nsxv3.common.synchronization [req-b578c96f-ca1b-4557-9ccf-a7d27532384e req-b8b601be-d5af-4081-942a-29f4962dd9a6 service nova] Enqueued Resource ID: 7ad9eae0-ba43-4dd1-a38c-756950552a19 with Priority: HIGHEST for action port [ 850.002842] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_rules [ 850.002996] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_members [ 850.003077] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ad9eae0-ba43-4dd1-a38c-756950552a19 with Priority: HIGHEST for action port [ 850.003382] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.003583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.004467] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.004467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.004467] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ad9eae0-ba43-4dd1-a38c-756950552a19 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.004467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ad9eae0-ba43-4dd1-a38c-756950552a19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.004467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ad9eae0-ba43-4dd1-a38c-756950552a19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.004467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ad9eae0-ba43-4dd1-a38c-756950552a19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.004467] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ad9eae0-ba43-4dd1-a38c-756950552a19',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.161227] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.161406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.161515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.161764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.161858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.161958] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9debc847-a741-46fa-9447-b1070c70a885 is going to be updated. [ 850.188820] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.188972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.189064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.189269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.189448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.197827] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: IN_PROGRESS for 2s [ 850.506888] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ad9eae0-ba43-4dd1-a38c-756950552a19 with status ACTIVE [ 850.507214] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.507323] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.507396] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.507632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.507749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.507931] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.508042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.508101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.508259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.508344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.508514] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.508600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.508654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.508793] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.508862] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.508943] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ad9eae0-ba43-4dd1-a38c-756950552a19 is going to be updated. [ 850.528946] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.529098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.529170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.529352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.529481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.529640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ad9eae0-ba43-4dd1-a38c-756950552a19" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.186633] env[69692]: INFO networking_nsxv3.common.synchronization [req-ef8cbb5b-3592-47b3-a0fc-552d0b27bbdf req-37f2d63c-f0bb-4468-a8ba-034e7e67c72a tempest-DeleteServersTestJSON-207338121 tempest-DeleteServersTestJSON-207338121-project-member] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 852.187237] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 852.187564] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.187705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.187778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.188023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.188184] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.188327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.188365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.188485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.188572] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.188691] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.206655] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: SUCCESS [ 852.206906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.207337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.207569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.207916] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.207916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.208072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.208152] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.208597] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.208597] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.208597] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.208597] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.208768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.208847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.208983] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.209109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.209172] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.209311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.209395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.209490] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.209577] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.210460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.211039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.211232] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.211342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.211405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.211541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.211616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.211704] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.597813] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.598021] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.598175] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.598454] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.598715] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.598872] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.598991] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.601886] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.602079] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.602344] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.602491] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.602611] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.602724] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.602840] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.602950] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.603110] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.629317] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.629409] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 852.629577] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.629700] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.630014] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-d4249365-6127-43db-8e62-34ebf969ac9f taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.630267] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-d4249365-6127-43db-8e62-34ebf969ac9f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.630343] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-d4249365-6127-43db-8e62-34ebf969ac9f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.630691] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-d4249365-6127-43db-8e62-34ebf969ac9f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.630838] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4249365-6127-43db-8e62-34ebf969ac9f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.690678] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.690832] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.690897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.691127] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.691470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.691470] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.691650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.691650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.691801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.691857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.691970] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be deleted. [ 852.713212] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9debc847-a741-46fa-9447-b1070c70a885: rpc.has_security_group_logging(os_id): False [ 852.716981] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.719307] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.719430] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.719499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.719687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.719774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.720077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.735445] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.735445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.735445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.735445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.735445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.735445] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.735445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.735445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.735445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.735445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.735445] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.735445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.735445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.735445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.735889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.735889] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.735889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.735889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.736090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.736090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.736148] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9debc847-a741-46fa-9447-b1070c70a885 is going to be created. [ 852.790712] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.790858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.791313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.791313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.791473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.800890] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: IN_PROGRESS for 2s [ 853.134571] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.134811] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.134938] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.135287] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.135495] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.135665] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port d4249365-6127-43db-8e62-34ebf969ac9f not found, creating... [ 853.135926] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.136103] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.136225] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.136452] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.136590] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.136871] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.137040] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.137165] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.137409] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.137554] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.137695] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: d4249365-6127-43db-8e62-34ebf969ac9f is going to be created. [ 853.156939] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.157152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.157283] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.157532] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.157756] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.158089] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-d4249365-6127-43db-8e62-34ebf969ac9f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.220275] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.722150] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.722150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.722150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.722453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.722580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.723341] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9debc847-a741-46fa-9447-b1070c70a885 is going to be updated. [ 853.752749] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.752898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.752971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.753195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.753365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.761776] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: IN_PROGRESS for 2s [ 853.962269] env[69692]: INFO networking_nsxv3.common.synchronization [req-ef8cbb5b-3592-47b3-a0fc-552d0b27bbdf req-665b14f4-a784-4f1f-8e9d-b7342981ca26 service nova] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_rules [ 853.962269] env[69692]: INFO networking_nsxv3.common.synchronization [req-ef8cbb5b-3592-47b3-a0fc-552d0b27bbdf req-665b14f4-a784-4f1f-8e9d-b7342981ca26 service nova] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 853.962269] env[69692]: INFO networking_nsxv3.common.synchronization [req-ef8cbb5b-3592-47b3-a0fc-552d0b27bbdf req-665b14f4-a784-4f1f-8e9d-b7342981ca26 service nova] Enqueued Resource ID: d4249365-6127-43db-8e62-34ebf969ac9f with Priority: HIGHEST for action port [ 853.962269] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_rules [ 853.962269] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 853.962269] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4249365-6127-43db-8e62-34ebf969ac9f with Priority: HIGHEST for action port [ 853.962269] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.962269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.962664] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.963071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.963239] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.968410] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.968676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.968829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.969214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.969483] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.969749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.969895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.970284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.970452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.970629] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.972439] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4249365-6127-43db-8e62-34ebf969ac9f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.972683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4249365-6127-43db-8e62-34ebf969ac9f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.972889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4249365-6127-43db-8e62-34ebf969ac9f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.973393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4249365-6127-43db-8e62-34ebf969ac9f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.973616] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4249365-6127-43db-8e62-34ebf969ac9f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.475978] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.476464] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.476464] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.477179] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4249365-6127-43db-8e62-34ebf969ac9f with status ACTIVE [ 854.477384] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.477522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.477580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.477773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.477863] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.478073] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.478154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.478228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.478362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.478545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.478629] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.478728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.478768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.479213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.479213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.479213] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4249365-6127-43db-8e62-34ebf969ac9f is going to be updated. [ 854.502496] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.502876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.503032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.503337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.503515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.503715] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4249365-6127-43db-8e62-34ebf969ac9f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.814396] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: SUCCESS [ 854.814644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.814885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.815097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.815198] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.980621] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.318206] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.318357] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.483740] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.484116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.484116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.484196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.484329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.484377] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be created. [ 855.507669] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.507823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.507869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.508096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.508253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.516784] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: UNINITIALIZED for 2s [ 855.770756] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: SUCCESS [ 855.770997] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.771149] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.771388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.771579] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.771696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.771760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.771914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.772009] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.772111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.772176] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.273988] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.274180] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.274257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.274482] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.274659] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.274756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.274843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.275066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.275118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.275194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.277799] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.277799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.277799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.277799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.277799] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.277799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.277799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.277799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.277799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.277799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.277799] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.778738] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9debc847-a741-46fa-9447-b1070c70a885: rpc.has_security_group_logging(os_id): False [ 856.798565] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.798739] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.798795] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.798994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.799107] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.799298] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.799399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.799468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.799608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.799678] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.799879] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.799987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.800055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.800179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.800251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.800428] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.800516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.800576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.800710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.800783] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.800869] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9debc847-a741-46fa-9447-b1070c70a885 is going to be updated. [ 856.869898] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.870074] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.870166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.870502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.870712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.888342] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: IN_PROGRESS for 2s [ 857.529016] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 857.529278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.529464] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.529686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.529885] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.530036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.530103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.530265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.530344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.530431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.530575] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.033191] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.033542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.033542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.033626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.033790] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.033889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.033953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.034116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.034315] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.034407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.034554] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.034648] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.034708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.034852] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.035045] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.035147] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.035210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.035354] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.035431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.035514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.035604] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.540452] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 532815ef-03c8-40fb-91ab-292fc1c769b2: rpc.has_security_group_logging(os_id): False [ 858.559069] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.559262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.559337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.559532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.559623] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.559835] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.559932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.559989] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.560335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.560335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.560437] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.560495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.560577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.560821] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.560821] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.561075] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.561075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.561269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.561312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.561464] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.561464] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be created. [ 858.629489] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.629702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.629753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.630012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.630285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.661351] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 858.900093] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: SUCCESS [ 858.900278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.962521] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 858.962641] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 860.675541] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 860.675779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.963999] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 863.963999] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 866.713043] env[69692]: INFO networking_nsxv3.common.synchronization [req-288105a4-c7d5-4af5-8d69-cb9a7cf943fc req-f0b5db83-def1-4b0b-9f2d-99cd590ab9d0 tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 866.714679] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 866.715143] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.715260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.715369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.716381] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.716697] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.716939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.717448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.717448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.717448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.718953] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.095863] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.095863] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.095863] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.095863] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.095863] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.096269] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.096312] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.096612] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.096767] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.097017] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.097174] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.097327] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.097469] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.097618] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.097760] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.097928] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.117482] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.117719] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.117902] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.118130] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.118564] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.118798] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.118962] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.119559] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.119771] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.222592] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.222755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.222816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.223043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.223152] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.223322] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.223454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.223454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.223611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.223699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.223785] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 already deleted. [ 867.223860] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.590322] env[69692]: INFO networking_nsxv3.common.synchronization [req-42061371-38bc-413f-84a5-31965a3df598 req-4fad96d8-8685-4b1b-8973-8cbf3e998db5 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 867.590666] env[69692]: INFO networking_nsxv3.common.synchronization [req-42061371-38bc-413f-84a5-31965a3df598 req-4fad96d8-8685-4b1b-8973-8cbf3e998db5 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_members [ 867.590666] env[69692]: INFO networking_nsxv3.common.synchronization [req-42061371-38bc-413f-84a5-31965a3df598 req-4fad96d8-8685-4b1b-8973-8cbf3e998db5 tempest-SecurityGroupsTestJSON-1251646811 tempest-SecurityGroupsTestJSON-1251646811-project-member] Enqueued Resource ID: f4dd1b93-af3a-481d-8833-92383b938f1f with Priority: HIGHEST for action security_group_members [ 867.592788] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 with Priority: HIGHEST for action security_group_members [ 867.592788] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 with Priority: HIGHEST for action security_group_members [ 867.592788] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4dd1b93-af3a-481d-8833-92383b938f1f with Priority: HIGHEST for action security_group_members [ 867.592788] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88a973-e953-4cb7-bda1-829fc68b91a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.592788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.592788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.592788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.592788] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.592788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.592788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.592788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.592788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.592788] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88a973-e953-4cb7-bda1-829fc68b91a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.593649] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.593709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.594527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.594527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.594527] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.594527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.594527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.594527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.594527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.595395] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.598021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4dd1b93-af3a-481d-8833-92383b938f1f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.598021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.598021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.598021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.598021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.598021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.598021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.598021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.598021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.598021] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4dd1b93-af3a-481d-8833-92383b938f1f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.622734] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.622955] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.623099] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.623507] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.623692] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.623831] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b not found, creating... [ 867.624169] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.624358] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.624500] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.624732] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.624876] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.625181] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.625342] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.625461] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.625673] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.625811] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.625949] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b is going to be created. [ 867.647084] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.647084] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.647084] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.647084] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.647348] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.647687] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.099894] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.099894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.099894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.099894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.099894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.099894] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.099894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.099894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.099894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.099894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.099894] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 is going to be updated. [ 868.101500] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.101500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.101500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.101500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.107030] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.107135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.124446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.124700] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.124816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.124883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.125094] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.125168] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.125257] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 is going to be updated. [ 868.126301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.127116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.137860] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.138057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.138057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.138207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.138342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.144763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.144989] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.145121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.145191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.145374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.145458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.145544] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4dd1b93-af3a-481d-8833-92383b938f1f is going to be updated. [ 868.147710] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: IN_PROGRESS for 2s [ 868.160549] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.160630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.160674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.160882] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.161045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.171117] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: IN_PROGRESS for 2s [ 868.178243] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.178378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.178491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.178703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.178842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.185903] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4dd1b93-af3a-481d-8833-92383b938f1f in Status: IN_PROGRESS for 2s [ 868.359017] env[69692]: INFO networking_nsxv3.common.synchronization [req-288105a4-c7d5-4af5-8d69-cb9a7cf943fc req-800cc141-d133-425b-b01d-c984d4f33ef1 service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 868.359145] env[69692]: INFO networking_nsxv3.common.synchronization [req-288105a4-c7d5-4af5-8d69-cb9a7cf943fc req-800cc141-d133-425b-b01d-c984d4f33ef1 service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 868.359294] env[69692]: INFO networking_nsxv3.common.synchronization [req-288105a4-c7d5-4af5-8d69-cb9a7cf943fc req-800cc141-d133-425b-b01d-c984d4f33ef1 service nova] Enqueued Resource ID: 23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b with Priority: HIGHEST for action port [ 868.359525] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 868.359651] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 868.359758] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b with Priority: HIGHEST for action port [ 868.360315] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.360467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.360546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.360851] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.361259] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.362751] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.362892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.362954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.363214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.363359] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.363462] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.363522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.363667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.363750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.363836] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.364886] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.364886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.364886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.365104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.365158] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.867797] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.868911] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.868999] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.869153] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b with status ACTIVE [ 868.869349] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.869470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.869549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.869734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.869819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.869985] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.870089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.870146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.870295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.870387] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.870550] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.870638] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.870690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.870893] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.871015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.873046] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b is going to be updated. [ 868.895594] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.895767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.895851] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.896098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.896287] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.896444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23ccfb0d-2ea9-4efe-b616-7cf9e0531b2b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.375615] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.882023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.882023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.882023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.882023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.882023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.882023] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be created. [ 869.901670] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.902785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.902891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.903154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.903328] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.913425] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: UNINITIALIZED for 2s [ 870.158500] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 in Status: SUCCESS [ 870.158661] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88a973-e953-4cb7-bda1-829fc68b91a4 deletion is rescheduled due to dependency. [ 870.158780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88a973-e953-4cb7-bda1-829fc68b91a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.181952] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 in Status: SUCCESS [ 870.182152] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2 deletion is rescheduled due to dependency. [ 870.182270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.199225] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4dd1b93-af3a-481d-8833-92383b938f1f in Status: SUCCESS [ 870.199225] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4dd1b93-af3a-481d-8833-92383b938f1f deletion is rescheduled due to dependency. [ 870.199225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.615885] env[69692]: INFO networking_nsxv3.common.synchronization [None req-61447493-61ab-438b-bd6c-06487109a456 tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGHEST for action security_group_rules [ 871.615885] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGHEST for action security_group_rules [ 871.616627] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-accdad5a-df21-4a41-8c89-449e7b8cd71b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.616627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.616627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.616627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.616627] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('accdad5a-df21-4a41-8c89-449e7b8cd71b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.746328] env[69692]: INFO networking_nsxv3.common.synchronization [None req-31e136f5-9b3d-4be0-9cff-c1949d38c775 tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGHEST for action security_group_rules [ 871.746328] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGHEST for action security_group_rules [ 871.746548] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-accdad5a-df21-4a41-8c89-449e7b8cd71b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.746786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.924555] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 871.924811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.927039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.927039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.927039] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.927039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.927039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.927039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.927039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.927039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.927039] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.135994] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.136154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.136229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.136421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.136517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.136603] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: accdad5a-df21-4a41-8c89-449e7b8cd71b already deleted. [ 872.136682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.136847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.137090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.137172] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('accdad5a-df21-4a41-8c89-449e7b8cd71b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.428497] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.428721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.428808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.429440] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.429440] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.429440] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.429440] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.429905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.429905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.429905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.430047] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.430226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.430301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.430428] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.430591] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.430716] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.430806] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.431020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.431215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.431215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.431447] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.657096] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.657555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.657555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.657650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.657650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.657755] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: accdad5a-df21-4a41-8c89-449e7b8cd71b already deleted. [ 872.657840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.933716] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eab15f99-d56d-4017-8640-5d7acb890c08: rpc.has_security_group_logging(os_id): False [ 872.951457] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.951631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.951876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.952588] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.953921] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.954260] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.954377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.954475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.954644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.954760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.954987] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.955133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.955200] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.955333] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.955390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.956439] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.956439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.956439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.956439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.956439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.956439] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be created. [ 873.013109] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.013109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.013109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.013109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.013109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.022723] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 873.440260] env[69692]: INFO networking_nsxv3.common.synchronization [req-7920d959-20aa-4161-8f54-b98daf92e13b req-0518248a-ff46-4239-a43b-955d31d34036 tempest-ServersTestFqdnHostnames-1208998322 tempest-ServersTestFqdnHostnames-1208998322-project-member] Enqueued Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGHEST for action security_group_members [ 873.440910] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGHEST for action security_group_members [ 873.441372] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8df4df4-eeff-413c-833f-3852b9a4a49a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.441534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.441598] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.441776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.441957] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.442088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.442158] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.442466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.442466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.442617] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.947330] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.947330] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.947330] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.947764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.976537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.976537] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.976537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.976537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.976537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.976537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.976537] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8df4df4-eeff-413c-833f-3852b9a4a49a is going to be updated. [ 873.998295] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.002417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.002417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.002417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.002417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.009638] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8df4df4-eeff-413c-833f-3852b9a4a49a in Status: IN_PROGRESS for 2s [ 874.072064] env[69692]: INFO networking_nsxv3.common.synchronization [req-0698d0f4-1709-443f-b724-21b3e621413a req-9bf30d70-81d6-480f-91d4-6ae83ffd67aa tempest-ServersWithSpecificFlavorTestJSON-467341840 tempest-ServersWithSpecificFlavorTestJSON-467341840-project-member] Enqueued Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_members [ 874.072064] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGHEST for action security_group_members [ 874.072357] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.072629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.072790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.073090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.073379] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.073694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.074014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.074275] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.074452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.074623] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.576998] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.577210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.577307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.577554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.577674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.577885] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.578036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.578105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.578269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.578348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.578437] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 is going to be updated. [ 874.607922] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.607922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.607922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.607922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.607922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.618155] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 in Status: IN_PROGRESS for 2s [ 875.034187] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 875.034187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.256413] env[69692]: INFO networking_nsxv3.common.synchronization [req-08064ea2-f6a8-49e3-86f0-16e2d867df0a req-a6d982ef-7152-4be7-b7a7-b20986390017 tempest-DeleteServersTestJSON-207338121 tempest-DeleteServersTestJSON-207338121-project-member] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 875.256913] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 875.257358] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.257358] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.257490] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.257624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.257771] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.257867] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.257918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.258108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.258188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.258279] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.760132] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.760299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.760372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.760589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.760680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.760871] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.760966] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.761040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.761211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.761288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.761431] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 875.792115] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.792115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.792115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.792316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.792889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.815129] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 876.021038] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8df4df4-eeff-413c-833f-3852b9a4a49a in Status: SUCCESS [ 876.021198] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8df4df4-eeff-413c-833f-3852b9a4a49a deletion is rescheduled due to dependency. [ 876.021763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.627559] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 in Status: SUCCESS [ 876.627843] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 deletion is rescheduled due to dependency. [ 876.627900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.824852] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 877.825178] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 deletion is rescheduled due to dependency. [ 877.825178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.257953] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 880.258249] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 881.818751] env[69692]: INFO networking_nsxv3.common.synchronization [req-bdf5a69a-6bc0-4897-a5c3-217a8f38f443 req-feb23c37-0622-42e7-a8ef-118f85d9f503 tempest-ServersAdminTestJSON-1982348900 tempest-ServersAdminTestJSON-1982348900-project-member] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 881.819378] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 881.819678] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.819952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.819952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.820792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.820994] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.821132] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.821197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.821407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.821501] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.821613] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.324645] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.644688] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.644688] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.644688] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.644972] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.645210] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.646787] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.646787] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.646787] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.646787] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.646787] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.646787] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.646787] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.646787] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.646787] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.646787] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.646787] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.671937] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.672187] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 882.672368] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.672563] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-356" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.673032] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-48ebd42f-d1d1-4809-a498-d6128b0e2f68 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.673793] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-48ebd42f-d1d1-4809-a498-d6128b0e2f68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.673793] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-48ebd42f-d1d1-4809-a498-d6128b0e2f68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.673793] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-48ebd42f-d1d1-4809-a498-d6128b0e2f68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.673793] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48ebd42f-d1d1-4809-a498-d6128b0e2f68',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.831423] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.179243] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.179953] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.180275] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.180474] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.183080] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.183080] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 48ebd42f-d1d1-4809-a498-d6128b0e2f68 not found, creating... [ 883.183080] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.183080] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.183080] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.183080] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.183080] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.183080] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.183080] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.183080] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.183652] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.183652] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.183652] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 48ebd42f-d1d1-4809-a498-d6128b0e2f68 is going to be created. [ 883.203061] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.203301] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.203441] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.203784] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.204044] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.204295] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-48ebd42f-d1d1-4809-a498-d6128b0e2f68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.337977] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.338194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.338262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.338507] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.338600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.338757] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 883.372582] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.372813] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.372897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.373144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.373294] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.386115] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 884.069602] env[69692]: INFO networking_nsxv3.common.synchronization [req-bdf5a69a-6bc0-4897-a5c3-217a8f38f443 req-458ea732-5575-4665-907c-d2d6844e7c43 service nova] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_rules [ 884.069889] env[69692]: INFO networking_nsxv3.common.synchronization [req-bdf5a69a-6bc0-4897-a5c3-217a8f38f443 req-458ea732-5575-4665-907c-d2d6844e7c43 service nova] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 884.069944] env[69692]: INFO networking_nsxv3.common.synchronization [req-bdf5a69a-6bc0-4897-a5c3-217a8f38f443 req-458ea732-5575-4665-907c-d2d6844e7c43 service nova] Enqueued Resource ID: 48ebd42f-d1d1-4809-a498-d6128b0e2f68 with Priority: HIGHEST for action port [ 884.070720] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_rules [ 884.070866] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 884.070968] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48ebd42f-d1d1-4809-a498-d6128b0e2f68 with Priority: HIGHEST for action port [ 884.071286] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.071435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.071523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.071721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.071826] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.075045] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.075045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.075045] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-48ebd42f-d1d1-4809-a498-d6128b0e2f68 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.075045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48ebd42f-d1d1-4809-a498-d6128b0e2f68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.075045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48ebd42f-d1d1-4809-a498-d6128b0e2f68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.075045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48ebd42f-d1d1-4809-a498-d6128b0e2f68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.075045] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48ebd42f-d1d1-4809-a498-d6128b0e2f68',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.433560] env[69692]: INFO networking_nsxv3.common.synchronization [req-ebeb88bc-98cc-4547-b9fd-39c3d7145e64 req-14a5d7a7-deba-4427-8c09-5d57a80fe88e tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGHEST for action security_group_members [ 884.434350] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGHEST for action security_group_members [ 884.434647] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a9da48-db34-4124-bc5a-acf3f884fbec taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.434772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.434838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.435631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.435798] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.435901] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.435962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.436295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.436417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.436517] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.579425] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.579425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.579425] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48ebd42f-d1d1-4809-a498-d6128b0e2f68 with status ACTIVE [ 884.579425] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.579425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.579425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.579425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.579425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.579425] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.579425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.579425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.579425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.579425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.579425] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.579892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.579892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.579892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.579892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.579892] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48ebd42f-d1d1-4809-a498-d6128b0e2f68 is going to be updated. [ 884.605047] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.605047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.605047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.605047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.605047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.605047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48ebd42f-d1d1-4809-a498-d6128b0e2f68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.875471] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.875471] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.875471] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.875471] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.875471] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.875471] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.875471] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.876652] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.876952] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.877314] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.880019] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.880019] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.880019] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.880019] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.880019] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.880019] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.897527] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.897527] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 884.897527] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.897527] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.897527] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-5b372c16-2c2d-4513-9b55-07a0a14896b5 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.897527] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-5b372c16-2c2d-4513-9b55-07a0a14896b5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.898015] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-5b372c16-2c2d-4513-9b55-07a0a14896b5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.898088] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-5b372c16-2c2d-4513-9b55-07a0a14896b5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.898183] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b372c16-2c2d-4513-9b55-07a0a14896b5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.939549] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.939950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.939950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.940180] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.940479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.940479] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.940780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.940780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.940973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.940973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.940973] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4a9da48-db34-4124-bc5a-acf3f884fbec already deleted. [ 884.941624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.395793] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 885.396058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.396222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.396440] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.396650] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.396770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.396834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.396986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.397119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.397175] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.401301] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.404017] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.404017] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.404017] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.404017] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.404017] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 5b372c16-2c2d-4513-9b55-07a0a14896b5 not found, creating... [ 885.404017] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.404017] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.404017] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.404017] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.404017] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.404417] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.404417] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.404417] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.404609] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.406304] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.406304] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 5b372c16-2c2d-4513-9b55-07a0a14896b5 is going to be created. [ 885.426230] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.426463] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.426595] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.426899] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.427150] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.427386] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-5b372c16-2c2d-4513-9b55-07a0a14896b5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.900649] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.402026] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.491570] env[69692]: INFO networking_nsxv3.common.synchronization [req-ebeb88bc-98cc-4547-b9fd-39c3d7145e64 req-6e7ec756-10b8-40d1-828c-f79ecaf6fd98 service nova] Enqueued Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGHEST for action security_group_rules [ 886.491570] env[69692]: INFO networking_nsxv3.common.synchronization [req-ebeb88bc-98cc-4547-b9fd-39c3d7145e64 req-6e7ec756-10b8-40d1-828c-f79ecaf6fd98 service nova] Enqueued Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGHEST for action security_group_members [ 886.491570] env[69692]: INFO networking_nsxv3.common.synchronization [req-ebeb88bc-98cc-4547-b9fd-39c3d7145e64 req-6e7ec756-10b8-40d1-828c-f79ecaf6fd98 service nova] Enqueued Resource ID: 5b372c16-2c2d-4513-9b55-07a0a14896b5 with Priority: HIGHEST for action port [ 886.492750] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGHEST for action security_group_rules [ 886.492943] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGHEST for action security_group_members [ 886.492943] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b372c16-2c2d-4513-9b55-07a0a14896b5 with Priority: HIGHEST for action port [ 886.493534] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4a9da48-db34-4124-bc5a-acf3f884fbec taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.493534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.493534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.494097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.494097] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.498017] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a9da48-db34-4124-bc5a-acf3f884fbec taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.498017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.498017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.498017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.498017] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.498017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.498017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.498017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.498017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.498017] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.498017] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b372c16-2c2d-4513-9b55-07a0a14896b5 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.498017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b372c16-2c2d-4513-9b55-07a0a14896b5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.498017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b372c16-2c2d-4513-9b55-07a0a14896b5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.498017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b372c16-2c2d-4513-9b55-07a0a14896b5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.498017] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b372c16-2c2d-4513-9b55-07a0a14896b5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.784089] env[69692]: INFO networking_nsxv3.common.synchronization [None req-c1ff523b-ad92-4702-be77-a8928ee23f28 None None] Enqueued Resource ID: 50b3150b-a210-4ab5-915f-084e0c3a3e90 with Priority: HIGHEST for action port [ 886.784089] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50b3150b-a210-4ab5-915f-084e0c3a3e90 with Priority: HIGHEST for action port [ 886.784089] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-50b3150b-a210-4ab5-915f-084e0c3a3e90 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.784089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50b3150b-a210-4ab5-915f-084e0c3a3e90" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.784089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50b3150b-a210-4ab5-915f-084e0c3a3e90" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.784089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50b3150b-a210-4ab5-915f-084e0c3a3e90" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.784089] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50b3150b-a210-4ab5-915f-084e0c3a3e90',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.907139] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.907139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.907139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.907139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.907139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.907139] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 886.934030] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.934030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.934030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.934030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.934030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.942531] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 887.001018] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a9da48-db34-4124-bc5a-acf3f884fbec taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.001018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.001018] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.001018] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b372c16-2c2d-4513-9b55-07a0a14896b5 with status ACTIVE [ 887.001018] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.001018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.001018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.001018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.001018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.001018] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.001018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.001018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.001018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.001018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.001798] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.001798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.001798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.001798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.001798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.001798] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b372c16-2c2d-4513-9b55-07a0a14896b5 is going to be updated. [ 887.033140] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.035307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.035307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.035307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.035307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.035307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b372c16-2c2d-4513-9b55-07a0a14896b5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.286198] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50b3150b-a210-4ab5-915f-084e0c3a3e90 [ 887.286438] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.286594] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.286664] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.286916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.287013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.287073] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50b3150b-a210-4ab5-915f-084e0c3a3e90 already deleted. [ 887.287160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50b3150b-a210-4ab5-915f-084e0c3a3e90" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.505059] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.008958] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.009191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.009269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.009587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.009705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.009815] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4a9da48-db34-4124-bc5a-acf3f884fbec is going to be created. [ 888.039972] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.039972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.039972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.039972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.039972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.047434] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a9da48-db34-4124-bc5a-acf3f884fbec in Status: UNINITIALIZED for 2s [ 888.220189] env[69692]: INFO networking_nsxv3.common.synchronization [None req-f76b6c5e-9d8d-4fb8-ae6e-bcda483be729 tempest-ServerRescueNegativeTestJSON-8223595 tempest-ServerRescueNegativeTestJSON-8223595-project-member] Enqueued Resource ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 with Priority: HIGHEST for action security_group_rules [ 888.220549] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 with Priority: HIGHEST for action security_group_rules [ 888.221666] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.222401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.222852] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.223496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.224151] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.328846] env[69692]: INFO networking_nsxv3.common.synchronization [None req-f3685514-9881-47fe-b84a-b69fcba7d9f4 tempest-ServerRescueNegativeTestJSON-8223595 tempest-ServerRescueNegativeTestJSON-8223595-project-member] Enqueued Resource ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 with Priority: HIGHEST for action security_group_rules [ 888.329087] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 with Priority: HIGHEST for action security_group_rules [ 888.330070] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.330070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.628234] env[69692]: INFO networking_nsxv3.common.synchronization [None req-f69cc1d7-b235-4bcb-9d00-1b130e4d469e None None] Enqueued Resource ID: 50696c8d-a3c7-43f4-a0e9-dd462e1dda8a with Priority: HIGHEST for action port [ 888.628234] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50696c8d-a3c7-43f4-a0e9-dd462e1dda8a with Priority: HIGHEST for action port [ 888.628234] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-50696c8d-a3c7-43f4-a0e9-dd462e1dda8a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.628234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50696c8d-a3c7-43f4-a0e9-dd462e1dda8a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.628234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50696c8d-a3c7-43f4-a0e9-dd462e1dda8a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.630421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50696c8d-a3c7-43f4-a0e9-dd462e1dda8a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.630523] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50696c8d-a3c7-43f4-a0e9-dd462e1dda8a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.744359] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.744546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.744607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.744807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.744909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.744982] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 already deleted. [ 888.745090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.745247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.745398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.745476] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.952078] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 888.952298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.952506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.952719] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.952949] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.953079] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.953228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.953368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.953368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.953471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.953721] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.133671] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50696c8d-a3c7-43f4-a0e9-dd462e1dda8a [ 889.134026] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.134172] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.134246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.134487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.134557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.134649] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50696c8d-a3c7-43f4-a0e9-dd462e1dda8a already deleted. [ 889.134729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50696c8d-a3c7-43f4-a0e9-dd462e1dda8a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.269104] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.269219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.269276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.269474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.269567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.269660] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 already deleted. [ 889.269741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.459157] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.459326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.459397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.459610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.459782] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.459877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.459940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.460102] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.460189] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.460276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.460446] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.460540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.460602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.460742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.460878] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.460967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.461033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.461171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.461246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.461326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.461452] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.968723] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aade30ad-1e65-411f-be2a-2831f287cfbc: rpc.has_security_group_logging(os_id): False [ 889.986588] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.986742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.986810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.987124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.004895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.005213] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.005341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.005405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.005618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.005704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.005890] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.005984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.006099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.006211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.006288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.006469] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.006611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.006644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.006770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.006837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.006923] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 890.058102] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a9da48-db34-4124-bc5a-acf3f884fbec in Status: SUCCESS [ 890.058508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.060016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.060016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.060016] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.060016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.060229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.060708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.060911] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.061141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.061319] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.087293] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.087293] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.087487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.087722] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.088155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.106791] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 890.564093] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.067209] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4a9da48-db34-4124-bc5a-acf3f884fbec: rpc.has_security_group_logging(os_id): False [ 891.085325] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.085566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.085566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.085834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.085942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.086151] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.086253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.086329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.086495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.086568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.086672] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4a9da48-db34-4124-bc5a-acf3f884fbec is going to be created. [ 891.147346] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.147607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.147607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.148167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.148167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.158663] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4a9da48-db34-4124-bc5a-acf3f884fbec in Status: IN_PROGRESS for 2s [ 891.833373] env[69692]: INFO networking_nsxv3.common.synchronization [req-04368c59-1ba4-4de5-a2b3-23fdf1249715 req-98d848ef-ce2b-4bc8-ab91-7a771e34e767 tempest-ListServerFiltersTestJSON-797986437 tempest-ListServerFiltersTestJSON-797986437-project-member] Enqueued Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 891.837032] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 with Priority: HIGHEST for action security_group_members [ 891.837032] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b6cb33c-9436-488b-bac4-02b8d09327a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.837032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.837032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.837032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.837032] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.837032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.837032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.837032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.837032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.837032] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b6cb33c-9436-488b-bac4-02b8d09327a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.121876] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 892.122251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.339199] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.339199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.339440] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.339509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.368296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.368296] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.368296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.368296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.368296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.368296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.368296] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 is going to be updated. [ 892.408103] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.408103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.408103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.408103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.408103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.414869] env[69692]: INFO networking_nsxv3.common.synchronization [None req-339e8882-3c57-45ba-b0e6-936dbbd26606 None None] Enqueued Resource ID: 30b9f9b8-35c4-43d6-9f1f-d83cd85ee076 with Priority: HIGHEST for action port [ 892.415241] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30b9f9b8-35c4-43d6-9f1f-d83cd85ee076 with Priority: HIGHEST for action port [ 892.415768] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-30b9f9b8-35c4-43d6-9f1f-d83cd85ee076 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.415894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30b9f9b8-35c4-43d6-9f1f-d83cd85ee076" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.416016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30b9f9b8-35c4-43d6-9f1f-d83cd85ee076" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.417955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30b9f9b8-35c4-43d6-9f1f-d83cd85ee076" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.417955] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30b9f9b8-35c4-43d6-9f1f-d83cd85ee076',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.419724] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: IN_PROGRESS for 2s [ 892.510913] env[69692]: INFO networking_nsxv3.common.synchronization [req-87095887-7a30-4c32-93ae-791bad778f2e req-3f9d5c87-9c18-4df4-9b77-6579c82aab71 tempest-ServerDiskConfigTestJSON-756528476 tempest-ServerDiskConfigTestJSON-756528476-project-member] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 892.511520] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 892.512183] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.512183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.512183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.512335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.512403] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.512496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.512564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.512707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.512797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.512873] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.923723] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30b9f9b8-35c4-43d6-9f1f-d83cd85ee076 [ 892.923723] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.923723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.923723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.927492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.927492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.927492] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30b9f9b8-35c4-43d6-9f1f-d83cd85ee076 already deleted. [ 892.927492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30b9f9b8-35c4-43d6-9f1f-d83cd85ee076" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.015476] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.015650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.015725] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.015944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.016057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.016512] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.016656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.016720] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.016884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.016966] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.017071] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 893.052300] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.052473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.052599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.052767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.052907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.061470] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 893.148658] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.149167] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.149167] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.153338] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.153338] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.153338] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.153338] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.153338] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.153338] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.153338] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.153338] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.153338] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.153338] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.153338] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.153338] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.153338] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.176462] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.176462] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 893.176462] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.176462] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.176462] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-4bdfebb4-0085-4e84-a983-2049d279a4be taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.176462] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-4bdfebb4-0085-4e84-a983-2049d279a4be" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.176462] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-4bdfebb4-0085-4e84-a983-2049d279a4be" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.176462] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-4bdfebb4-0085-4e84-a983-2049d279a4be" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.176462] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bdfebb4-0085-4e84-a983-2049d279a4be',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.178252] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4a9da48-db34-4124-bc5a-acf3f884fbec in Status: SUCCESS [ 893.178658] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.680758] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.681112] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.681195] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.681608] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.681752] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.681958] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 4bdfebb4-0085-4e84-a983-2049d279a4be not found, creating... [ 893.682228] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.682392] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.682513] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.682773] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.682926] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.683234] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.683388] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.683590] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.683846] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.684047] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.684186] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 4bdfebb4-0085-4e84-a983-2049d279a4be is going to be created. [ 893.703262] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.703262] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.703262] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.703262] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.703262] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.703600] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-4bdfebb4-0085-4e84-a983-2049d279a4be" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.426031] env[69692]: INFO networking_nsxv3.common.synchronization [None req-07d3fa4c-ef10-47f7-9df0-608e7a49e0d0 None None] Enqueued Resource ID: 65b0d432-1ad7-47c5-8462-f257bb27331e with Priority: HIGHEST for action port [ 894.426031] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65b0d432-1ad7-47c5-8462-f257bb27331e with Priority: HIGHEST for action port [ 894.429255] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-65b0d432-1ad7-47c5-8462-f257bb27331e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.429255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65b0d432-1ad7-47c5-8462-f257bb27331e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.429255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65b0d432-1ad7-47c5-8462-f257bb27331e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.429255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65b0d432-1ad7-47c5-8462-f257bb27331e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.429255] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65b0d432-1ad7-47c5-8462-f257bb27331e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.434363] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 in Status: SUCCESS [ 894.434363] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b6cb33c-9436-488b-bac4-02b8d09327a1 deletion is rescheduled due to dependency. [ 894.434363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b6cb33c-9436-488b-bac4-02b8d09327a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.442023] env[69692]: INFO networking_nsxv3.common.synchronization [req-87095887-7a30-4c32-93ae-791bad778f2e req-3910cd5b-f002-4ff2-9b1e-9147f2a52012 service nova] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_rules [ 894.442023] env[69692]: INFO networking_nsxv3.common.synchronization [req-87095887-7a30-4c32-93ae-791bad778f2e req-3910cd5b-f002-4ff2-9b1e-9147f2a52012 service nova] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 894.442023] env[69692]: INFO networking_nsxv3.common.synchronization [req-87095887-7a30-4c32-93ae-791bad778f2e req-3910cd5b-f002-4ff2-9b1e-9147f2a52012 service nova] Enqueued Resource ID: 4bdfebb4-0085-4e84-a983-2049d279a4be with Priority: HIGHEST for action port [ 894.442023] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_rules [ 894.442023] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 894.442023] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bdfebb4-0085-4e84-a983-2049d279a4be with Priority: HIGHEST for action port [ 894.442023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.442023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.442023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.442023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.445439] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.446570] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.447245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.448363] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bdfebb4-0085-4e84-a983-2049d279a4be taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.448709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bdfebb4-0085-4e84-a983-2049d279a4be" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.448709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bdfebb4-0085-4e84-a983-2049d279a4be" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.449456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bdfebb4-0085-4e84-a983-2049d279a4be" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.449456] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bdfebb4-0085-4e84-a983-2049d279a4be',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.930360] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65b0d432-1ad7-47c5-8462-f257bb27331e [ 894.930824] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.930824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.930824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.931020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.932337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.932626] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65b0d432-1ad7-47c5-8462-f257bb27331e already deleted. [ 894.932779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65b0d432-1ad7-47c5-8462-f257bb27331e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.951493] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.951676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.956456] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bdfebb4-0085-4e84-a983-2049d279a4be with status ACTIVE [ 894.958893] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.959165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.959165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.959406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.959543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.959685] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.959803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.959847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.959984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.960084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.960269] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.960363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.960572] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.960572] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.960672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.960745] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bdfebb4-0085-4e84-a983-2049d279a4be is going to be updated. [ 894.981391] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.982059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.982059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.985198] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.985385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.985782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bdfebb4-0085-4e84-a983-2049d279a4be" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.072102] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 895.072300] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 deletion is rescheduled due to dependency. [ 895.072421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.072605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.072889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.073169] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.073311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.073380] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.073547] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.073633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.073759] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.579742] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.082962] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.587059] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.587495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.587495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.587756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.587914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.589030] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 896.626713] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.627282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.627395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.627614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.627757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.638197] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 898.648764] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 898.651646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.651646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.651646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.651646] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.651646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.651646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.651646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.651646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.651646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.651646] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.185383] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.185383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.185383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.185383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.185383] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.185383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.185383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.185383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.185383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.185383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.185383] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.185383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.185383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.185383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.185383] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.185383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.186274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.186274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.186274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.186274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.186274] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.442557] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 899.446425] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 899.663208] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcbeb6f9-c515-4ff5-9c1f-1b944526d767: rpc.has_security_group_logging(os_id): False [ 899.681219] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.681362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.681533] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.681768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.681858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.682703] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.682703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.682703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.682703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.682703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.682703] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.682936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.682936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.682995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.683744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.683982] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.684118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.684185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.684355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.684438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.684527] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 899.758669] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.758839] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.758912] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.759137] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.759286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.780158] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 900.033123] env[69692]: INFO networking_nsxv3.common.synchronization [req-467d3258-ac63-4ca9-8f28-eaea5d6d9d52 req-76084497-b6b3-4fa7-805e-31545557c597 tempest-ServersTestMultiNic-1078791388 tempest-ServersTestMultiNic-1078791388-project-member] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 900.033664] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 900.034127] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.034228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.034228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.034490] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.034672] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.035338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.035338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.035338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.035338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.035338] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.538818] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.539126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.539126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.539335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.539540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.540136] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.540136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.540136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.540136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.540335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.540335] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c already deleted. [ 900.540335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.715214] env[69692]: INFO networking_nsxv3.common.synchronization [req-467d3258-ac63-4ca9-8f28-eaea5d6d9d52 req-6a85ec27-a8ce-4b95-8b67-aed68795b483 tempest-ServersTestMultiNic-1078791388 tempest-ServersTestMultiNic-1078791388-project-member] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 900.715657] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 900.715959] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.719569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.719653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.719873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.720066] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.720175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.720238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.720398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.720481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.720573] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.873364] env[69692]: INFO networking_nsxv3.common.synchronization [None req-ce14d48c-0775-48c4-95b1-5d8b18931a3e None None] Enqueued Resource ID: e122caeb-e948-4355-b987-3d131b1bb081 with Priority: HIGHEST for action port [ 900.873452] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e122caeb-e948-4355-b987-3d131b1bb081 with Priority: HIGHEST for action port [ 900.873978] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-e122caeb-e948-4355-b987-3d131b1bb081 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.878020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e122caeb-e948-4355-b987-3d131b1bb081" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.878020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e122caeb-e948-4355-b987-3d131b1bb081" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.878020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e122caeb-e948-4355-b987-3d131b1bb081" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.878020] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e122caeb-e948-4355-b987-3d131b1bb081',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.224434] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.224434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.224434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.225622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.225622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.226019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.226719] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.226719] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.227351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.227351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.227351] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c already deleted. [ 901.227351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.240932] env[69692]: INFO networking_nsxv3.common.synchronization [req-f61d085f-2e1a-4ffe-868c-08800f625146 req-90cc9a4d-3adf-4a6b-9372-7b5c319555de tempest-ServersTestManualDisk-923673515 tempest-ServersTestManualDisk-923673515-project-member] Enqueued Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGHEST for action security_group_members [ 901.242192] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGHEST for action security_group_members [ 901.242192] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.242192] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.242368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.242567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.243744] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.243744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.243744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.243744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.243744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.243744] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3aeeb294-14c6-4fb6-bbb6-67a12deabbef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.376762] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e122caeb-e948-4355-b987-3d131b1bb081 [ 901.377629] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.377629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.377629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.377629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.377629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.377629] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e122caeb-e948-4355-b987-3d131b1bb081 already deleted. [ 901.377629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e122caeb-e948-4355-b987-3d131b1bb081" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.421396] env[69692]: INFO networking_nsxv3.common.synchronization [req-467d3258-ac63-4ca9-8f28-eaea5d6d9d52 req-cc2ccb43-aa30-466f-959a-6219c00c1ffb tempest-ServersTestMultiNic-1078791388 tempest-ServersTestMultiNic-1078791388-project-member] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 901.422030] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 901.422355] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.422489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.423049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.423049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.423049] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.423049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.423266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.423266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.423538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.423538] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.748825] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.748825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.748825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.748825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.770768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.770969] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.771119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.771185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.771391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.771526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.771605] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef is going to be updated. [ 901.794321] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 901.794321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.799931] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.799931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.799931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.799931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.799931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.808473] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef in Status: IN_PROGRESS for 2s [ 901.926178] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.926420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.926467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.926709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.926749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.927092] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.927092] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.927092] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.927413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.927413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.927413] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c already deleted. [ 901.927525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.175725] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.175928] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-842" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.176071] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-842" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.176419] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-842" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.177399] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.177576] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.177754] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.178058] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.178113] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.178336] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.178454] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.178569] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.178685] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.178790] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.179245] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.179316] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.204938] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.205165] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 902.205315] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.205504] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-842" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.205830] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-dd142ba9-5b20-4d82-a7ed-51b523068360 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.206016] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-dd142ba9-5b20-4d82-a7ed-51b523068360" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.206141] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-dd142ba9-5b20-4d82-a7ed-51b523068360" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.206488] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-dd142ba9-5b20-4d82-a7ed-51b523068360" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.206632] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd142ba9-5b20-4d82-a7ed-51b523068360',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.670869] env[69692]: INFO networking_nsxv3.common.synchronization [req-ef496073-7463-4ea7-8420-81e0fb293030 req-8926291e-889b-4082-a1f1-b3202270a10a tempest-ServerActionsV293TestJSON-586801738 tempest-ServerActionsV293TestJSON-586801738-project-member] Enqueued Resource ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a with Priority: HIGHEST for action security_group_members [ 902.671067] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a with Priority: HIGHEST for action security_group_members [ 902.671392] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.672748] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.672849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.673137] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.673308] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.673422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.673493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.673655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.673744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.673862] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.711727] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.711727] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.711871] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.712146] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.712316] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.712470] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port dd142ba9-5b20-4d82-a7ed-51b523068360 not found, creating... [ 902.712780] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.712979] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.713124] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.713364] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.713505] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.714067] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.714067] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.714190] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.714455] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.714583] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.714621] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: dd142ba9-5b20-4d82-a7ed-51b523068360 is going to be created. [ 902.733174] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.733458] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.733534] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.733766] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.733992] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.734346] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-dd142ba9-5b20-4d82-a7ed-51b523068360" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.842956] env[69692]: INFO networking_nsxv3.common.synchronization [None req-5cc25118-4e21-4761-9831-e4fe2c43fc18 tempest-ServersV294TestFqdnHostnames-879312321 tempest-ServersV294TestFqdnHostnames-879312321-project-member] Enqueued Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGHEST for action security_group_rules [ 902.843589] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGHEST for action security_group_rules [ 902.843923] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.844063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.844129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.844400] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.844496] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e7c8a7-d992-42fb-849a-a4f4ddc2f188',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.952537] env[69692]: INFO networking_nsxv3.common.synchronization [None req-889a88a5-17ff-4d9a-a72a-a027e2d71111 tempest-ServersV294TestFqdnHostnames-879312321 tempest-ServersV294TestFqdnHostnames-879312321-project-member] Enqueued Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGHEST for action security_group_rules [ 902.953129] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGHEST for action security_group_rules [ 902.953442] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.953540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.117039] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-474 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.117039] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-474" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.117039] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-474" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.118591] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-474" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.118591] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.118591] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.118591] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.118591] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.118904] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.119140] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.119310] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.119382] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.119507] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.119637] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.120271] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.120449] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.138793] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.143835] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 903.143835] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.143835] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-474" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.143835] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-ad867f88-d4d2-454a-ae36-07477f044647 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.143835] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-ad867f88-d4d2-454a-ae36-07477f044647" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.143835] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-ad867f88-d4d2-454a-ae36-07477f044647" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.143835] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-ad867f88-d4d2-454a-ae36-07477f044647" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.144043] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad867f88-d4d2-454a-ae36-07477f044647',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.177926] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.178362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.178362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.178362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.178516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.178660] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.178753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.178816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.178966] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.179054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.179140] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a already deleted. [ 903.179219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.362264] env[69692]: INFO networking_nsxv3.common.synchronization [None req-40c5ecaf-429c-4973-9565-1a7859fae024 None None] Enqueued Resource ID: 8aab6cea-5342-49d6-aaf5-cd5226cb67fd with Priority: HIGHEST for action port [ 903.363031] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aab6cea-5342-49d6-aaf5-cd5226cb67fd with Priority: HIGHEST for action port [ 903.363172] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-8aab6cea-5342-49d6-aaf5-cd5226cb67fd taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.363301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8aab6cea-5342-49d6-aaf5-cd5226cb67fd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.363402] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8aab6cea-5342-49d6-aaf5-cd5226cb67fd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.363632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8aab6cea-5342-49d6-aaf5-cd5226cb67fd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.363719] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8aab6cea-5342-49d6-aaf5-cd5226cb67fd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.366640] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.367448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.367542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.367747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.368283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.368410] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 already deleted. [ 903.368565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.369151] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.369203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.369286] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e7c8a7-d992-42fb-849a-a4f4ddc2f188',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.647801] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.648135] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.648726] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.648726] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.648834] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.648904] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port ad867f88-d4d2-454a-ae36-07477f044647 not found, creating... [ 903.649216] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.649440] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.649626] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.649874] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.654063] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.654439] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.654612] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.654739] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.655350] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.655546] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.655706] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: ad867f88-d4d2-454a-ae36-07477f044647 is going to be created. [ 903.673796] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.674023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.674154] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.674517] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.674705] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.674934] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-ad867f88-d4d2-454a-ae36-07477f044647" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.780972] env[69692]: INFO networking_nsxv3.common.synchronization [req-467d3258-ac63-4ca9-8f28-eaea5d6d9d52 req-458280b9-5204-4807-84ef-e89197cc0064 service nova] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_rules [ 903.781256] env[69692]: INFO networking_nsxv3.common.synchronization [req-467d3258-ac63-4ca9-8f28-eaea5d6d9d52 req-458280b9-5204-4807-84ef-e89197cc0064 service nova] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 903.781421] env[69692]: INFO networking_nsxv3.common.synchronization [req-467d3258-ac63-4ca9-8f28-eaea5d6d9d52 req-458280b9-5204-4807-84ef-e89197cc0064 service nova] Enqueued Resource ID: dd142ba9-5b20-4d82-a7ed-51b523068360 with Priority: HIGHEST for action port [ 903.781693] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_rules [ 903.781815] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 903.781921] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd142ba9-5b20-4d82-a7ed-51b523068360 with Priority: HIGHEST for action port [ 903.782525] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.782653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.782805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.782945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.783018] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.784994] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.784994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.784994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.784994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.784994] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.785183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.785183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.785292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.785393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.785468] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.787467] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd142ba9-5b20-4d82-a7ed-51b523068360 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.787467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd142ba9-5b20-4d82-a7ed-51b523068360" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.787467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd142ba9-5b20-4d82-a7ed-51b523068360" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.787467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd142ba9-5b20-4d82-a7ed-51b523068360" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.787467] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd142ba9-5b20-4d82-a7ed-51b523068360',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.817864] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef in Status: SUCCESS [ 903.818100] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef deletion is rescheduled due to dependency. [ 903.818216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.868908] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8aab6cea-5342-49d6-aaf5-cd5226cb67fd [ 903.868908] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.868908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.868908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.868908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.868908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.868908] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8aab6cea-5342-49d6-aaf5-cd5226cb67fd already deleted. [ 903.868908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8aab6cea-5342-49d6-aaf5-cd5226cb67fd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.889439] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.889608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.889700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.889904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.889991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.890103] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 already deleted. [ 903.890212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.291480] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.291737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.291836] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.292747] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd142ba9-5b20-4d82-a7ed-51b523068360 with status ACTIVE [ 904.292927] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.293063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.293131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.293330] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.293416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.293589] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.293686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.293748] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.293929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.294023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.295880] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.296013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.296090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.296280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.296324] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.296406] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd142ba9-5b20-4d82-a7ed-51b523068360 is going to be updated. [ 904.318648] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.318973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.318973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.319087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.319621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.319621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd142ba9-5b20-4d82-a7ed-51b523068360" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.489602] env[69692]: INFO networking_nsxv3.common.synchronization [req-ef496073-7463-4ea7-8420-81e0fb293030 req-1510b25b-26fc-4fd8-b3db-b1e32a46d357 service nova] Enqueued Resource ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a with Priority: HIGHEST for action security_group_rules [ 904.490568] env[69692]: INFO networking_nsxv3.common.synchronization [req-ef496073-7463-4ea7-8420-81e0fb293030 req-1510b25b-26fc-4fd8-b3db-b1e32a46d357 service nova] Enqueued Resource ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a with Priority: HIGHEST for action security_group_members [ 904.490568] env[69692]: INFO networking_nsxv3.common.synchronization [req-ef496073-7463-4ea7-8420-81e0fb293030 req-1510b25b-26fc-4fd8-b3db-b1e32a46d357 service nova] Enqueued Resource ID: ad867f88-d4d2-454a-ae36-07477f044647 with Priority: HIGHEST for action port [ 904.490568] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a with Priority: HIGHEST for action security_group_rules [ 904.490708] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a with Priority: HIGHEST for action security_group_members [ 904.490737] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad867f88-d4d2-454a-ae36-07477f044647 with Priority: HIGHEST for action port [ 904.491711] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.491871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.491871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.492120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.492226] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.493134] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.493343] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.493343] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.493561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.494361] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.494361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.494361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.494361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.494361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.494361] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.495238] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad867f88-d4d2-454a-ae36-07477f044647 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.495459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad867f88-d4d2-454a-ae36-07477f044647" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.495568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad867f88-d4d2-454a-ae36-07477f044647" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.495750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad867f88-d4d2-454a-ae36-07477f044647" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.495959] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad867f88-d4d2-454a-ae36-07477f044647',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.798864] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.955050] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-687 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.955375] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-687" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.955430] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-687" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.955710] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-687" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.955984] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.956161] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.956283] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.956506] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.956654] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.960730] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.960730] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.960730] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.960730] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.960730] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.960730] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.960730] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.976236] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.977270] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 904.977988] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.978238] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-687" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.978562] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.978742] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.978865] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.979204] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.979350] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.998134] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.998283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.998501] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.999160] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad867f88-d4d2-454a-ae36-07477f044647 with status ACTIVE [ 904.999333] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.999507] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.999564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.999766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.999848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.000017] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.000112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.000170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.000315] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.000388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.000562] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.002640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.002995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.002995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.002995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.002995] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad867f88-d4d2-454a-ae36-07477f044647 is going to be updated. [ 905.022220] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.022356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.022427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.022660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.022779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.022932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad867f88-d4d2-454a-ae36-07477f044647" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.300164] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.300335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.300388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.300603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.300692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.300789] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be created. [ 905.326049] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.326213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.326318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.326496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.326658] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.335423] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: UNINITIALIZED for 2s [ 905.485661] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.485917] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.486052] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.486343] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.486501] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.486687] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5 not found, creating... [ 905.486976] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.487226] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.487226] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.487457] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.487600] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.487929] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.488136] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.488294] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.488538] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.488731] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.488974] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5 is going to be created. [ 905.505260] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.508625] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.508848] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.508970] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.509329] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.509470] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.509692] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.008576] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.008994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.008994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.009098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.009098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.009210] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a is going to be created. [ 906.038638] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.038638] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.038638] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.038814] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.038899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.050259] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a in Status: UNINITIALIZED for 2s [ 906.302448] env[69692]: INFO networking_nsxv3.common.synchronization [req-467d3258-ac63-4ca9-8f28-eaea5d6d9d52 req-3da67260-08b9-4c40-89d0-23e86091979c service nova] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_rules [ 906.302648] env[69692]: INFO networking_nsxv3.common.synchronization [req-467d3258-ac63-4ca9-8f28-eaea5d6d9d52 req-3da67260-08b9-4c40-89d0-23e86091979c service nova] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 906.302800] env[69692]: INFO networking_nsxv3.common.synchronization [req-467d3258-ac63-4ca9-8f28-eaea5d6d9d52 req-3da67260-08b9-4c40-89d0-23e86091979c service nova] Enqueued Resource ID: 9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5 with Priority: HIGHEST for action port [ 906.303314] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_rules [ 906.303442] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 906.303532] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5 with Priority: HIGHEST for action port [ 906.303810] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.303920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.306853] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.306853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.307277] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.308322] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.308322] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.308322] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.308322] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.810714] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5 with status ACTIVE [ 906.810950] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.811099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.811171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.811391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.811479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.811681] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.811782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.811846] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.811999] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.812088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.812270] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.812383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.812449] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.812592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.812669] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.812751] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5 is going to be updated. [ 906.842232] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.842411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.842509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.842693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.842824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.842973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bb5f74f-5cd3-425d-a1c5-2c0cac3ebad5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.166068] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.166378] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-842" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.166426] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-842" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.166691] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-842" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.166962] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.167140] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.167263] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.167501] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.167637] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.167934] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 907.168079] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.168353] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.168353] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.168456] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 907.168516] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.168657] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.186316] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.186848] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 907.186848] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.186848] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-842" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.187130] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-0075968e-2916-43b8-8234-9e6cbbb6a254 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.187306] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-0075968e-2916-43b8-8234-9e6cbbb6a254" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.187695] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-0075968e-2916-43b8-8234-9e6cbbb6a254" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.187791] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-0075968e-2916-43b8-8234-9e6cbbb6a254" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.187906] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0075968e-2916-43b8-8234-9e6cbbb6a254',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.345225] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 907.345473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.345706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.345851] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.346056] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.346171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.346272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.346395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.346476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.346563] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.346659] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.347500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.347670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.347827] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.347925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.347988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.348664] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.348753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.348841] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.690946] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.691520] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.691520] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.691763] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.692364] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.692364] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 0075968e-2916-43b8-8234-9e6cbbb6a254 not found, creating... [ 907.692585] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.692880] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.693083] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.694023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.694023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.694023] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.694023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.694743] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.694743] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.694743] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.694743] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 0075968e-2916-43b8-8234-9e6cbbb6a254 is going to be created. [ 907.715607] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.715924] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.716160] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.716497] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.716779] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.717064] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-0075968e-2916-43b8-8234-9e6cbbb6a254" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.851159] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.851327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.853038] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.062193] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a in Status: SUCCESS [ 908.062453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.063230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.063489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.064849] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.065044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.065907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.065907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.065907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.065907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.065907] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.355940] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.528520] env[69692]: INFO networking_nsxv3.common.synchronization [req-467d3258-ac63-4ca9-8f28-eaea5d6d9d52 req-58257994-068f-4721-857d-ab3937e502f2 service nova] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_rules [ 908.528520] env[69692]: INFO networking_nsxv3.common.synchronization [req-467d3258-ac63-4ca9-8f28-eaea5d6d9d52 req-58257994-068f-4721-857d-ab3937e502f2 service nova] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 908.528787] env[69692]: INFO networking_nsxv3.common.synchronization [req-467d3258-ac63-4ca9-8f28-eaea5d6d9d52 req-58257994-068f-4721-857d-ab3937e502f2 service nova] Enqueued Resource ID: 0075968e-2916-43b8-8234-9e6cbbb6a254 with Priority: HIGHEST for action port [ 908.531366] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_rules [ 908.531558] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 908.533237] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0075968e-2916-43b8-8234-9e6cbbb6a254 with Priority: HIGHEST for action port [ 908.533987] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.533987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.534836] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.534836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.534836] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-0075968e-2916-43b8-8234-9e6cbbb6a254 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.534836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0075968e-2916-43b8-8234-9e6cbbb6a254" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.534836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0075968e-2916-43b8-8234-9e6cbbb6a254" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.535077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0075968e-2916-43b8-8234-9e6cbbb6a254" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.535077] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0075968e-2916-43b8-8234-9e6cbbb6a254',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.568588] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.859023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.859358] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.859358] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.859557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.859687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.859837] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 908.887076] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.887201] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.887274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.887745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.887745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.895759] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 909.037748] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0075968e-2916-43b8-8234-9e6cbbb6a254 with status ACTIVE [ 909.037748] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.037933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.037933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.038193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.038301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.038524] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.038653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.038727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.038924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.039049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.039308] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.039413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.039629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.039681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.039737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.039853] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0075968e-2916-43b8-8234-9e6cbbb6a254 is going to be updated. [ 909.060685] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.060814] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.060861] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.061087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.061233] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.061386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0075968e-2916-43b8-8234-9e6cbbb6a254" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.070909] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a: rpc.has_security_group_logging(os_id): False [ 909.090483] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.090483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.090483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.090689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.090738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.090975] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.092493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.092493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.092493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.092493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.092493] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a is going to be created. [ 909.201301] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.201301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.201301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.201301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.201301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.221461] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a in Status: IN_PROGRESS for 2s [ 910.908136] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 910.908366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.908553] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.909965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.911827] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.912061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.912300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.912370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.912411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.912511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.912723] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.912814] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.912877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.913311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.913488] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.913590] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.913659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.913801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.913884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.913959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.914061] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.915875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.915947] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.916106] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.916259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.916259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.916403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.916480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.916571] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.235849] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a in Status: SUCCESS [ 911.235849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.421134] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c: rpc.has_security_group_logging(os_id): False [ 911.422887] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.444272] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.444502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.444623] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.444934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.445170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.445468] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.449153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.449153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.449153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.449378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.449720] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.449873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.449977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.450272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.450426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.450915] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.451109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.451214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.451448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.451589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.451730] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be created. [ 911.507436] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.507807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.507957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.508413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.508628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.527081] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 911.928168] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.430894] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.431109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.431185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.431383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.431470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.431615] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 912.459637] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.460311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.460311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.460311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.460431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.471225] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 913.535033] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 913.535033] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 913.539797] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 913.539797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.539797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.539797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.539797] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.673211] env[69692]: INFO networking_nsxv3.common.synchronization [req-58a996ed-2325-4926-afdf-bbbc20216313 req-ed558de5-3b93-480a-a132-85f10197458c tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGHEST for action security_group_members [ 913.674078] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGHEST for action security_group_members [ 913.675483] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-accdad5a-df21-4a41-8c89-449e7b8cd71b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.675483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.675483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.675483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.676558] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.676558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.676558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.676558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.676558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.676558] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('accdad5a-df21-4a41-8c89-449e7b8cd71b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.045819] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.045819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.153313] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.153611] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.153856] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.155753] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.156423] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.156668] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.156753] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.157107] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.157301] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.157545] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.157666] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.157783] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.157896] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.158043] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.158223] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.158479] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 914.177711] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 914.177711] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 914.177711] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 914.177711] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.178022] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-ccc1108a-785f-4d69-8ada-a1183a44c7b6 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.178022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-ccc1108a-785f-4d69-8ada-a1183a44c7b6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.178163] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-ccc1108a-785f-4d69-8ada-a1183a44c7b6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.181106] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-ccc1108a-785f-4d69-8ada-a1183a44c7b6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.181106] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccc1108a-785f-4d69-8ada-a1183a44c7b6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.181106] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.181106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.181106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.181106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.181106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.181106] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.181106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.181106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.181106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.181106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.181106] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: accdad5a-df21-4a41-8c89-449e7b8cd71b already deleted. [ 914.181106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.478233] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 914.478233] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.478420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.478666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.479177] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.479177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.479177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.479577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.479577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.479577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.479577] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.682182] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.682604] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.682849] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.683226] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.683412] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.683578] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port ccc1108a-785f-4d69-8ada-a1183a44c7b6 not found, creating... [ 914.683854] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.684029] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.684169] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.684408] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.684627] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.684858] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.684989] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.685124] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.685337] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.685485] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.685607] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: ccc1108a-785f-4d69-8ada-a1183a44c7b6 is going to be created. [ 914.707039] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.707039] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.707039] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.707039] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.707039] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.707039] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-ccc1108a-785f-4d69-8ada-a1183a44c7b6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.981929] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.982154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.982252] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.982535] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.982769] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.982904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.982991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.983219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.983332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.983449] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.983648] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.983804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.983935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.984064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.984257] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.984377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.984461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.984643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.984747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.984855] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.984984] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.495860] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c: rpc.has_security_group_logging(os_id): False [ 915.512410] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.512594] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.512706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.513098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.513203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.513453] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.513567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.513634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.513828] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.513915] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.514122] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.519494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.519494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.519494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.519494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.519494] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.519494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.519494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.519494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.519494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.519494] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 915.568038] env[69692]: INFO networking_nsxv3.common.synchronization [req-58a996ed-2325-4926-afdf-bbbc20216313 req-e86f6d8a-66a2-40c8-8253-d4f1843efb29 service nova] Enqueued Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGHEST for action security_group_rules [ 915.568038] env[69692]: INFO networking_nsxv3.common.synchronization [req-58a996ed-2325-4926-afdf-bbbc20216313 req-e86f6d8a-66a2-40c8-8253-d4f1843efb29 service nova] Enqueued Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGHEST for action security_group_members [ 915.568038] env[69692]: INFO networking_nsxv3.common.synchronization [req-58a996ed-2325-4926-afdf-bbbc20216313 req-e86f6d8a-66a2-40c8-8253-d4f1843efb29 service nova] Enqueued Resource ID: ccc1108a-785f-4d69-8ada-a1183a44c7b6 with Priority: HIGHEST for action port [ 915.568038] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGHEST for action security_group_rules [ 915.568038] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGHEST for action security_group_members [ 915.568038] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc1108a-785f-4d69-8ada-a1183a44c7b6 with Priority: HIGHEST for action port [ 915.568038] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-accdad5a-df21-4a41-8c89-449e7b8cd71b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.568864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.568864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.568864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.568864] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('accdad5a-df21-4a41-8c89-449e7b8cd71b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.569827] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-accdad5a-df21-4a41-8c89-449e7b8cd71b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.569964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.570067] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.570305] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.570482] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.570568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.570641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.570908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.571035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.571188] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('accdad5a-df21-4a41-8c89-449e7b8cd71b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.572191] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccc1108a-785f-4d69-8ada-a1183a44c7b6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.572299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccc1108a-785f-4d69-8ada-a1183a44c7b6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.572366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccc1108a-785f-4d69-8ada-a1183a44c7b6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.572521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccc1108a-785f-4d69-8ada-a1183a44c7b6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.572598] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccc1108a-785f-4d69-8ada-a1183a44c7b6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.575274] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.575274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.575359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.575592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.575648] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.587700] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 916.074674] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-accdad5a-df21-4a41-8c89-449e7b8cd71b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.074674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.082289] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('accdad5a-df21-4a41-8c89-449e7b8cd71b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.082289] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccc1108a-785f-4d69-8ada-a1183a44c7b6 with status ACTIVE [ 916.082289] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.082289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.082289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.082289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.082289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.082289] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.082289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.082289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.082289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.082289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.082289] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.082289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.082289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.082289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.082725] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.082725] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccc1108a-785f-4d69-8ada-a1183a44c7b6 is going to be updated. [ 916.103057] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.103057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.103057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.103057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.103411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.103411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccc1108a-785f-4d69-8ada-a1183a44c7b6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.586409] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('accdad5a-df21-4a41-8c89-449e7b8cd71b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.087736] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.088051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.088051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.088326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.088428] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.088535] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: accdad5a-df21-4a41-8c89-449e7b8cd71b is going to be created. [ 917.115101] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.115293] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.115367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.115532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.115698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.125216] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: accdad5a-df21-4a41-8c89-449e7b8cd71b in Status: UNINITIALIZED for 2s [ 917.601356] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 917.601356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.601356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.601497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.604037] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.105177] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.105492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.105492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.105621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.105786] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.105888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.105992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.106124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.106212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.106302] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.106414] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.609806] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.610205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.610316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.610539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.610718] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.610841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.610877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.611061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.611157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.611248] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.611420] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.611516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.611780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.611848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.611948] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.612068] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.612130] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.612279] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.612369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.612474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.612569] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.120050] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c: rpc.has_security_group_logging(os_id): False [ 919.133524] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: accdad5a-df21-4a41-8c89-449e7b8cd71b in Status: UNINITIALIZED for 4s [ 919.135924] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.136107] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.136181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.136391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.137070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.137070] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.137070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.137070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.137070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.137281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.137281] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.137354] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.137409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.137546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.137620] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.137835] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.137931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.137992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.138654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.138951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.139099] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 919.206640] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.207041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.207151] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.207404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.207575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.223102] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 920.207669] env[69692]: INFO networking_nsxv3.common.synchronization [req-244c4afd-5d22-4d9d-b955-9fe3b6795c9d req-5e59ee4b-9329-453a-b329-afc2bb16f81e tempest-MigrationsAdminTest-1006177328 tempest-MigrationsAdminTest-1006177328-project-member] Enqueued Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_members [ 920.208113] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_members [ 920.208505] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.209080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.209080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.209080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.209080] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.209338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.209338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.209408] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.209441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.209582] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.716990] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.144985] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: accdad5a-df21-4a41-8c89-449e7b8cd71b in Status: SUCCESS [ 921.145360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.145603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.145839] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.146084] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.146280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.146394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.146659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.147016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.147626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.147750] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('accdad5a-df21-4a41-8c89-449e7b8cd71b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.217752] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.237481] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 921.237481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.650849] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('accdad5a-df21-4a41-8c89-449e7b8cd71b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.719625] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.719708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.720450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.720450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.720450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.720450] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803064c7-17f8-46ee-bdf3-20357514c794 is going to be updated. [ 921.755027] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.755027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.755027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.755027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.755523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.767739] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: IN_PROGRESS for 2s [ 921.881487] env[69692]: INFO networking_nsxv3.common.synchronization [req-bf443645-c00b-4b6b-8ca0-cefa166a3840 req-ab7a8555-4485-4c74-a4fc-9de55395e8a2 tempest-ServersAdminTestJSON-1982348900 tempest-ServersAdminTestJSON-1982348900-project-member] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 921.882052] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 921.882353] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.882475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.882541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.882786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.882967] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.883484] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.883670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.883751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.883802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.883895] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.107322] env[69692]: INFO networking_nsxv3.common.synchronization [req-62257e88-1885-41cd-a47e-42a0e1e70262 req-230349eb-8a0f-4c8d-82c1-f242f9bab696 tempest-ServersTestMultiNic-1078791388 tempest-ServersTestMultiNic-1078791388-project-member] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 922.107840] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 922.108157] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.108282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.108347] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.108552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.109011] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.109011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.109011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.109177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.109177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.109237] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.154266] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for accdad5a-df21-4a41-8c89-449e7b8cd71b: rpc.has_security_group_logging(os_id): False [ 922.170563] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.170741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.170796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.170995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.171087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.171308] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.171416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.171469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.171642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.171710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.171788] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: accdad5a-df21-4a41-8c89-449e7b8cd71b is going to be created. [ 922.238513] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.238949] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.238949] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.238949] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.239126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.254935] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: accdad5a-df21-4a41-8c89-449e7b8cd71b in Status: IN_PROGRESS for 2s [ 922.387224] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.611586] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.651815] env[69692]: INFO networking_nsxv3.common.synchronization [req-62257e88-1885-41cd-a47e-42a0e1e70262 req-37ba3606-fb4e-497e-bc30-8e93355bb98f tempest-ServersTestMultiNic-1078791388 tempest-ServersTestMultiNic-1078791388-project-member] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 922.652300] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 922.652615] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.652765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.886667] env[69692]: INFO networking_nsxv3.common.synchronization [req-62257e88-1885-41cd-a47e-42a0e1e70262 req-a04a4ad2-cfe1-4c6b-b506-04df913b1a13 tempest-ServersTestMultiNic-1078791388 tempest-ServersTestMultiNic-1078791388-project-member] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 922.886667] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 922.887422] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.887422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.888693] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.114679] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.391317] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.391668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.391668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.391790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.391910] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.392081] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 923.419767] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.421052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.421052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.421052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.421052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.429094] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 923.617243] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.617497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.617583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.617800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.617895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.617994] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 923.644474] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.644630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.644703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.644911] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.648081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.660396] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 923.777751] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: SUCCESS [ 923.777751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.266265] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: accdad5a-df21-4a41-8c89-449e7b8cd71b in Status: SUCCESS [ 924.266496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.699791] env[69692]: INFO networking_nsxv3.common.synchronization [req-8428ac26-55f9-4dd8-8ef6-0a5d4439f98c req-4058c7fc-8dc9-4b2e-a875-95a255baf4d4 tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 924.700499] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 924.700943] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.702195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.702470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.703849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.704238] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.704575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.704715] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.705666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.705802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.705962] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.209234] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.333201] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.333201] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.333201] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.333201] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.334249] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.334613] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.335135] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.335484] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.335725] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.336084] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.336373] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.336611] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.337332] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.337808] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 925.339094] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.339258] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.363767] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.363949] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 925.364112] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.364302] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.364615] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-29a883f0-39cf-4c8f-b983-8857afd8bb0e taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.364789] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-29a883f0-39cf-4c8f-b983-8857afd8bb0e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.364912] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-29a883f0-39cf-4c8f-b983-8857afd8bb0e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.365270] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-29a883f0-39cf-4c8f-b983-8857afd8bb0e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.365440] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29a883f0-39cf-4c8f-b983-8857afd8bb0e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.438687] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 925.438687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.669270] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 925.669529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.669782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.670026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.670223] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.670342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.670409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.670563] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.670645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.670739] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.714268] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.874133] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.874133] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.874133] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.874133] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.874133] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.874133] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 29a883f0-39cf-4c8f-b983-8857afd8bb0e not found, creating... [ 925.874133] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.874133] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.874133] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.874133] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.874133] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.874557] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.874557] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.874557] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.874934] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.875011] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.875171] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 29a883f0-39cf-4c8f-b983-8857afd8bb0e is going to be created. [ 925.899152] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.899469] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.899652] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.900019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.900304] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.900586] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-29a883f0-39cf-4c8f-b983-8857afd8bb0e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.173537] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.173537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.173537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.173787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.173787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.173984] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.174081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.174175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.174268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.174338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.174429] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 926.198517] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.198678] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.198749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.198942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.199093] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.206650] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 926.216617] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.216617] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.216779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.217186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.217322] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.217459] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 926.244037] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.244208] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.244280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.244495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.244632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.252697] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 926.611615] env[69692]: INFO networking_nsxv3.common.synchronization [req-8428ac26-55f9-4dd8-8ef6-0a5d4439f98c req-ef4ab03a-5247-43a9-94a1-5b4da0909f9e service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 926.611860] env[69692]: INFO networking_nsxv3.common.synchronization [req-8428ac26-55f9-4dd8-8ef6-0a5d4439f98c req-ef4ab03a-5247-43a9-94a1-5b4da0909f9e service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 926.611988] env[69692]: INFO networking_nsxv3.common.synchronization [req-8428ac26-55f9-4dd8-8ef6-0a5d4439f98c req-ef4ab03a-5247-43a9-94a1-5b4da0909f9e service nova] Enqueued Resource ID: 29a883f0-39cf-4c8f-b983-8857afd8bb0e with Priority: HIGHEST for action port [ 926.613535] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 926.613535] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 926.613664] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a883f0-39cf-4c8f-b983-8857afd8bb0e with Priority: HIGHEST for action port [ 926.614215] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.614344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.614410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.614732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.614732] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.617056] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.617148] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.617348] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-29a883f0-39cf-4c8f-b983-8857afd8bb0e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.617442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29a883f0-39cf-4c8f-b983-8857afd8bb0e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.617505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29a883f0-39cf-4c8f-b983-8857afd8bb0e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.617684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29a883f0-39cf-4c8f-b983-8857afd8bb0e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.617761] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29a883f0-39cf-4c8f-b983-8857afd8bb0e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.119143] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.119431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.121586] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29a883f0-39cf-4c8f-b983-8857afd8bb0e with status ACTIVE [ 927.121733] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.121879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.121926] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.122146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.122237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.123025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.123025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.123025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.123025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.123025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.123025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.123288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.123288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.123288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.123362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.123404] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29a883f0-39cf-4c8f-b983-8857afd8bb0e is going to be updated. [ 927.143158] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.144040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.144040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.144171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.144519] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.144519] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29a883f0-39cf-4c8f-b983-8857afd8bb0e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.381865] env[69692]: INFO networking_nsxv3.common.synchronization [req-cf2fee09-96a0-488d-838d-fc17e4d421cf req-ccee7c54-c03b-4d44-802a-4de56fc5014e tempest-MultipleCreateTestJSON-73038672 tempest-MultipleCreateTestJSON-73038672-project-member] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 927.382425] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 927.382740] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.382868] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.382938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.383329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.383491] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.383596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.383659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.383819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.383903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.383995] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.886879] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.887038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.887385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.887385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.887385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.887604] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.887679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.887728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.887864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.887960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.888913] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be updated. [ 927.910849] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.911015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.911417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.911417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.911417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.920884] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 927.961428] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-473 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.961502] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.961804] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.962124] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.962534] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.962800] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.963038] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.963401] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.963650] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.963979] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.964194] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.964385] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.964574] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.964818] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.964988] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.965222] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.983369] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.983616] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 927.983824] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.984900] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.984900] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-cd3405d8-b5e7-451d-bf54-0037f03bad66 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.984900] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-cd3405d8-b5e7-451d-bf54-0037f03bad66" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.984900] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-cd3405d8-b5e7-451d-bf54-0037f03bad66" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.985389] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-cd3405d8-b5e7-451d-bf54-0037f03bad66" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.985691] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd3405d8-b5e7-451d-bf54-0037f03bad66',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.216888] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 928.216888] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c deletion is rescheduled due to dependency. [ 928.216888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.216888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.216888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.217458] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.217458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.217458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.217458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.217458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.217458] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.261881] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 928.262867] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.262867] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.262867] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.262867] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.262867] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.263116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.263116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.263229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.263315] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.494663] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.494856] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.494856] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.495147] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.495303] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.495482] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port cd3405d8-b5e7-451d-bf54-0037f03bad66 not found, creating... [ 928.495752] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.495927] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.496406] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.496406] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.496504] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.496930] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.496930] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.497266] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.497442] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.497660] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.497848] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: cd3405d8-b5e7-451d-bf54-0037f03bad66 is going to be created. [ 928.519762] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.520643] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.520857] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.521203] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.522160] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.522663] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-cd3405d8-b5e7-451d-bf54-0037f03bad66" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.720386] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.720543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.720585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.720812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.720909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.721127] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.721226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.721312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.721468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.721545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.721637] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 928.751412] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.751789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.751789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.752115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.752115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.761263] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 928.765662] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.268445] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.302435] env[69692]: INFO networking_nsxv3.common.synchronization [req-cf2fee09-96a0-488d-838d-fc17e4d421cf req-0fe974e8-cda2-4fb0-ba24-b640575a622e service nova] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_rules [ 929.302621] env[69692]: INFO networking_nsxv3.common.synchronization [req-cf2fee09-96a0-488d-838d-fc17e4d421cf req-0fe974e8-cda2-4fb0-ba24-b640575a622e service nova] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 929.302806] env[69692]: INFO networking_nsxv3.common.synchronization [req-cf2fee09-96a0-488d-838d-fc17e4d421cf req-0fe974e8-cda2-4fb0-ba24-b640575a622e service nova] Enqueued Resource ID: cd3405d8-b5e7-451d-bf54-0037f03bad66 with Priority: HIGHEST for action port [ 929.303086] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_rules [ 929.303237] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 929.303334] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd3405d8-b5e7-451d-bf54-0037f03bad66 with Priority: HIGHEST for action port [ 929.303860] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.303964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.304589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.304821] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.304911] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.307897] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.307897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.307897] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd3405d8-b5e7-451d-bf54-0037f03bad66 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.307897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd3405d8-b5e7-451d-bf54-0037f03bad66" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.307897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd3405d8-b5e7-451d-bf54-0037f03bad66" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.307897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd3405d8-b5e7-451d-bf54-0037f03bad66" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.307897] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd3405d8-b5e7-451d-bf54-0037f03bad66',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.771708] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.771885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.772177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.772262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.772357] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.772457] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 929.802812] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.802974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.803038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.803853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.803853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.808150] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.808365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.808854] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd3405d8-b5e7-451d-bf54-0037f03bad66 with status ACTIVE [ 929.809038] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.809146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.809211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.809404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.809488] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.809665] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.809780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.809841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.809992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.810082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.810261] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.810355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.810416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.810556] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.810628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.810709] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd3405d8-b5e7-451d-bf54-0037f03bad66 is going to be updated. [ 929.814852] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 929.835364] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.835505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.835576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.835786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.835909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.836098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd3405d8-b5e7-451d-bf54-0037f03bad66" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.902963] env[69692]: INFO networking_nsxv3.common.synchronization [req-cf2fee09-96a0-488d-838d-fc17e4d421cf req-f747443b-50b8-4c80-a3b7-a4c0eca74e2c tempest-MultipleCreateTestJSON-73038672 tempest-MultipleCreateTestJSON-73038672-project-member] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 929.903490] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 929.903789] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.903895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.935209] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 929.935209] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 deletion is rescheduled due to dependency. [ 929.935209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.935667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.935892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.936072] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.936191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.936258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.936417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.936499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.936590] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.247751] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-473 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.247967] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.248111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.248388] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.248647] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.248807] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.248928] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.249160] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.249318] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.249525] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.249675] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.249779] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.249897] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.250023] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 930.250132] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.250269] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.268591] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.268853] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 930.268906] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.269043] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-473" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.269334] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-f2a20db5-9b59-4ff5-b93a-b4393b8126a8 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.269504] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-f2a20db5-9b59-4ff5-b93a-b4393b8126a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.269625] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-f2a20db5-9b59-4ff5-b93a-b4393b8126a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.269965] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-f2a20db5-9b59-4ff5-b93a-b4393b8126a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.270120] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2a20db5-9b59-4ff5-b93a-b4393b8126a8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.439220] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.771199] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 930.771438] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c deletion is rescheduled due to dependency. [ 930.771604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.772169] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.772386] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.772499] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.772775] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.772922] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.773082] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port f2a20db5-9b59-4ff5-b93a-b4393b8126a8 not found, creating... [ 930.773342] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.773495] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.773619] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.773842] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.773987] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.774311] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.774476] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.774597] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.774812] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.774954] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.775108] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: f2a20db5-9b59-4ff5-b93a-b4393b8126a8 is going to be created. [ 930.793272] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.793562] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.793562] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.793869] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.794169] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.794416] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-f2a20db5-9b59-4ff5-b93a-b4393b8126a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.942335] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.445411] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.446482] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.446647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.446941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.447114] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.447232] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be updated. [ 931.486707] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.486707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.486707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.486707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.486707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.494446] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 931.648268] env[69692]: INFO networking_nsxv3.common.synchronization [req-cf2fee09-96a0-488d-838d-fc17e4d421cf req-3569d3ae-7b91-4019-86b0-5432d2d4db2b service nova] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_rules [ 931.648451] env[69692]: INFO networking_nsxv3.common.synchronization [req-cf2fee09-96a0-488d-838d-fc17e4d421cf req-3569d3ae-7b91-4019-86b0-5432d2d4db2b service nova] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 931.648591] env[69692]: INFO networking_nsxv3.common.synchronization [req-cf2fee09-96a0-488d-838d-fc17e4d421cf req-3569d3ae-7b91-4019-86b0-5432d2d4db2b service nova] Enqueued Resource ID: f2a20db5-9b59-4ff5-b93a-b4393b8126a8 with Priority: HIGHEST for action port [ 931.648820] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_rules [ 931.648942] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 931.649049] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2a20db5-9b59-4ff5-b93a-b4393b8126a8 with Priority: HIGHEST for action port [ 931.649584] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.649782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.649923] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.650168] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.650363] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2a20db5-9b59-4ff5-b93a-b4393b8126a8 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.650497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2a20db5-9b59-4ff5-b93a-b4393b8126a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.650582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2a20db5-9b59-4ff5-b93a-b4393b8126a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.650804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2a20db5-9b59-4ff5-b93a-b4393b8126a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.650911] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2a20db5-9b59-4ff5-b93a-b4393b8126a8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.825463] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 931.825463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.825463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.825463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.825463] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.825463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.825463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.825463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.825463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.825463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.825463] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.152795] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2a20db5-9b59-4ff5-b93a-b4393b8126a8 with status ACTIVE [ 932.153125] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.153269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.153358] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.153567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.153659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.153834] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.154131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.154131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.154253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.154253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.154409] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.154497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.154561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.154700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.154776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.154859] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2a20db5-9b59-4ff5-b93a-b4393b8126a8 is going to be updated. [ 932.175506] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.175506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.175652] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.175752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.175892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.176053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2a20db5-9b59-4ff5-b93a-b4393b8126a8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.329554] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.329789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.329839] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.330096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.330286] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.330416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.330485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.330646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.330732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.330822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.330969] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.331075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.331136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.331277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.331413] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.331504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.331565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.331747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.331854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.331914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.332010] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.834347] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eab15f99-d56d-4017-8640-5d7acb890c08: rpc.has_security_group_logging(os_id): False [ 932.851541] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.851740] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.852209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.852209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.852209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.852391] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.852458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.852528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.852662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.852715] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.852874] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.852959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.853028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.853169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.853232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.853419] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.853502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.853560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.853700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.853806] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.853854] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 932.913317] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.913481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.913520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.913735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.913883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.953302] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 933.511387] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 933.511733] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.512042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.512404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.512756] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.512952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.513090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.513398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.513538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.513660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.513773] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.515084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.515402] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.515752] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.516338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.516338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.516494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.516630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.516810] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.019107] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.019553] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.019553] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.522520] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.968459] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 934.968732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.024634] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.024634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.024983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.025920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.025920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.025920] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be updated. [ 935.053547] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.053681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.053748] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.053949] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.054145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.062782] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 936.649939] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 936.650209] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 937.074134] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 937.074386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.074559] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.074778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.075030] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.075128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.075188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.075317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.075401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.075495] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.579926] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.082236] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.344969] env[69692]: INFO networking_nsxv3.common.synchronization [req-b780dd9b-fe3d-4295-9ba9-a5efca96550d req-26a65ee5-aa37-4516-b5c5-5f6c013d08aa tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 938.346497] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 938.347146] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.347372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.347372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.347539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.347690] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.347782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.347839] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.347979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.348070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.348158] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.585546] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.585709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.585918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.586593] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.586593] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.586593] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be updated. [ 938.612167] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.612315] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.612393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.613125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.613125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.621027] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 938.850968] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.923626] env[69692]: INFO networking_nsxv3.common.synchronization [req-6e6a58a2-c6d7-4321-b26f-b020c8db99e4 req-c1857622-e91e-4d2e-8344-2e21de43f8dd tempest-ImagesTestJSON-510458365 tempest-ImagesTestJSON-510458365-project-member] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 938.924567] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 938.924567] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.924793] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.924793] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.925262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.925637] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.925747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.925810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.926194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.926194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.926194] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.324405] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.324767] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.324767] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.325272] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.325338] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.325498] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.325738] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.325949] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.326545] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.326545] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.326545] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.326673] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.326755] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.326854] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.326959] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.327105] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.347775] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.347775] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 939.347775] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.347775] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.347775] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-981d3597-bb6c-4587-b18c-a6f74be23111 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.347775] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-981d3597-bb6c-4587-b18c-a6f74be23111" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.347775] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-981d3597-bb6c-4587-b18c-a6f74be23111" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.348121] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-981d3597-bb6c-4587-b18c-a6f74be23111" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.348121] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('981d3597-bb6c-4587-b18c-a6f74be23111',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.353933] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.428238] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.428403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.428476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.428691] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.428780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.428974] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.429540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.429621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.429811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.429941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.429986] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e already deleted. [ 939.430085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.850845] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.850845] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.850845] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.850845] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.851138] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.851187] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 981d3597-bb6c-4587-b18c-a6f74be23111 not found, creating... [ 939.851452] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.851627] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.851771] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.852059] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.852215] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.852981] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.852981] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.852981] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.853187] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.853231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.853397] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 981d3597-bb6c-4587-b18c-a6f74be23111 is going to be created. [ 939.857167] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.857313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.857377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.857534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.857618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.857705] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 939.877607] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.877806] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.877941] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.878636] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.878636] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.878816] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-981d3597-bb6c-4587-b18c-a6f74be23111" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.884042] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.884194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.884267] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.884465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.884608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.897032] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 940.634246] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.634246] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.634246] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.634246] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.634246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.635171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.635171] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.729955] env[69692]: INFO networking_nsxv3.common.synchronization [req-6e6a58a2-c6d7-4321-b26f-b020c8db99e4 req-c72946c0-6481-471c-8b56-472fc1254370 service nova] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_rules [ 940.730236] env[69692]: INFO networking_nsxv3.common.synchronization [req-6e6a58a2-c6d7-4321-b26f-b020c8db99e4 req-c72946c0-6481-471c-8b56-472fc1254370 service nova] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 940.730340] env[69692]: INFO networking_nsxv3.common.synchronization [req-6e6a58a2-c6d7-4321-b26f-b020c8db99e4 req-c72946c0-6481-471c-8b56-472fc1254370 service nova] Enqueued Resource ID: 981d3597-bb6c-4587-b18c-a6f74be23111 with Priority: HIGHEST for action port [ 940.730545] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_rules [ 940.730670] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 940.730820] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981d3597-bb6c-4587-b18c-a6f74be23111 with Priority: HIGHEST for action port [ 940.731961] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.733207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.733207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.733207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.733207] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.734289] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.734341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.734517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.734730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.734892] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.734991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.735067] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.737262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.737262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.737262] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.737262] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-981d3597-bb6c-4587-b18c-a6f74be23111 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.737262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-981d3597-bb6c-4587-b18c-a6f74be23111" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.737262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-981d3597-bb6c-4587-b18c-a6f74be23111" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.737262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-981d3597-bb6c-4587-b18c-a6f74be23111" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.737262] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('981d3597-bb6c-4587-b18c-a6f74be23111',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.139578] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9: rpc.has_security_group_logging(os_id): False [ 941.156698] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.156836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.157022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.157128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.157221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.157429] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.157530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.157594] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.157749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.157826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.158073] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.158392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.158439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.158573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.158682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.158852] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.158956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.159231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.159383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.159461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.159554] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be updated. [ 941.214711] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.214932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.215253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.215253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.215427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.229400] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 941.238061] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.238061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.240586] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 981d3597-bb6c-4587-b18c-a6f74be23111 with status ACTIVE [ 941.240586] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.240778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.240817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.241032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.241186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.241397] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.241558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.241558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.241886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.242120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.242435] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.242640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.243184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.243184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.243184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.243322] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 981d3597-bb6c-4587-b18c-a6f74be23111 is going to be updated. [ 941.244672] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.265053] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.265197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.265268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.265470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.265603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.265761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-981d3597-bb6c-4587-b18c-a6f74be23111" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.747674] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.905937] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 941.906221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.249790] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.249981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.250035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.250253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.250340] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.250438] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be created. [ 942.275332] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.275543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.276074] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.276074] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.276248] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.285291] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: UNINITIALIZED for 2s [ 942.528563] env[69692]: INFO networking_nsxv3.common.synchronization [req-de6e80b6-7b6a-4a54-b4ac-4461f488a4e3 req-8d2cdc16-ae9c-4e54-bcf6-2ae836d98017 tempest-ServerRescueNegativeTestJSON-8223595 tempest-ServerRescueNegativeTestJSON-8223595-project-member] Enqueued Resource ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 with Priority: HIGHEST for action security_group_members [ 942.529139] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 with Priority: HIGHEST for action security_group_members [ 942.530006] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.530191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.530266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.530549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.530725] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.530883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.530951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.531150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.531237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.531330] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.948651] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-328 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.949012] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-328" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.949012] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-328" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.949131] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-328" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.949372] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.949537] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.949656] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.949878] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.951931] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.952228] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.952363] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.952480] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.952595] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.952714] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.952823] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.952982] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.991779] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.991959] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 942.992126] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.992306] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-328" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.992654] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-fb768f9a-7df5-400a-9458-4db7712c1e5d taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.992808] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-fb768f9a-7df5-400a-9458-4db7712c1e5d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.992963] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-fb768f9a-7df5-400a-9458-4db7712c1e5d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.993323] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-fb768f9a-7df5-400a-9458-4db7712c1e5d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.993513] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb768f9a-7df5-400a-9458-4db7712c1e5d',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.033348] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.033550] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.033627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.033807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.033902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.034121] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.034226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.034281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.034408] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.034483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.034565] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 already deleted. [ 943.034643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.244610] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 943.244610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.244714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.245361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.245361] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.365921] env[69692]: INFO networking_nsxv3.common.synchronization [req-fe0d2191-5c8d-4a9b-8288-df6069f993b8 req-9d3a7251-17d3-4c40-b256-f6d937ef6df6 tempest-MultipleCreateTestJSON-73038672 tempest-MultipleCreateTestJSON-73038672-project-member] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 943.370454] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 943.370852] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.370983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.371129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.371346] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.371501] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.371607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.371665] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.371846] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.371933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.372038] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.496217] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.496468] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.496602] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.496899] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.497067] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.497232] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port fb768f9a-7df5-400a-9458-4db7712c1e5d not found, creating... [ 943.497486] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.497643] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.497767] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.498013] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.498169] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.498448] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.498604] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.498722] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.498955] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.499274] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.499462] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: fb768f9a-7df5-400a-9458-4db7712c1e5d is going to be created. [ 943.529687] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.530232] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.530476] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.531134] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.532769] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.533288] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-fb768f9a-7df5-400a-9458-4db7712c1e5d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.559856] env[69692]: INFO networking_nsxv3.common.synchronization [req-677df403-48fe-4f19-b780-d74a035be90a req-3c39b46a-cb3e-491c-b8d0-5d13f7044b3d tempest-MultipleCreateTestJSON-73038672 tempest-MultipleCreateTestJSON-73038672-project-member] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 943.560408] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGHEST for action security_group_members [ 943.560750] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.560835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.747375] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.747483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.874146] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.295127] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 944.295383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.295511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.295727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.295921] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.296050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.296116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.296281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.296361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.296447] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.296536] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.319048] env[69692]: INFO networking_nsxv3.common.synchronization [req-de6e80b6-7b6a-4a54-b4ac-4461f488a4e3 req-469d637e-ed6b-4f68-bd7b-f8380c9ff61d service nova] Enqueued Resource ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 with Priority: HIGHEST for action security_group_rules [ 944.319267] env[69692]: INFO networking_nsxv3.common.synchronization [req-de6e80b6-7b6a-4a54-b4ac-4461f488a4e3 req-469d637e-ed6b-4f68-bd7b-f8380c9ff61d service nova] Enqueued Resource ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 with Priority: HIGHEST for action security_group_members [ 944.319410] env[69692]: INFO networking_nsxv3.common.synchronization [req-de6e80b6-7b6a-4a54-b4ac-4461f488a4e3 req-469d637e-ed6b-4f68-bd7b-f8380c9ff61d service nova] Enqueued Resource ID: fb768f9a-7df5-400a-9458-4db7712c1e5d with Priority: HIGHEST for action port [ 944.319916] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 with Priority: HIGHEST for action security_group_rules [ 944.320321] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 with Priority: HIGHEST for action security_group_members [ 944.320321] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb768f9a-7df5-400a-9458-4db7712c1e5d with Priority: HIGHEST for action port [ 944.320598] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.320732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.320796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.320991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.321086] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.321972] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.322565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.322565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.323042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.323042] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.323042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.323179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.323268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.323314] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.323406] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.324205] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb768f9a-7df5-400a-9458-4db7712c1e5d taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.324327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb768f9a-7df5-400a-9458-4db7712c1e5d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.324383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb768f9a-7df5-400a-9458-4db7712c1e5d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.324608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb768f9a-7df5-400a-9458-4db7712c1e5d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.324608] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb768f9a-7df5-400a-9458-4db7712c1e5d',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.375783] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.678668] env[69692]: INFO networking_nsxv3.common.synchronization [None req-3f5919e7-4323-4199-9794-2b59c2121d1b tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGHEST for action security_group_rules [ 944.679203] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGHEST for action security_group_rules [ 944.679532] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.679653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.679736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.680040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.680169] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1d9a7ff-d6e8-45b7-a6eb-87684637dd08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.746610] env[69692]: INFO networking_nsxv3.common.synchronization [None req-9a5f227b-d497-4b4d-b954-0e3a9dbb108e tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGHEST for action security_group_rules [ 944.747116] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGHEST for action security_group_rules [ 944.747417] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.747520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.801365] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.801526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.801598] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.801857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.802049] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.802157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.802221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.802438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.802495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.802645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.802721] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.802815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.802882] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.803102] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.803188] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.803281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.803341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.803479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.803557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.803639] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.803727] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.825886] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.831035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.831035] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb768f9a-7df5-400a-9458-4db7712c1e5d with status ACTIVE [ 944.831035] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.831035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.831035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.831035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.831035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.831035] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.831035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.831035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.831035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.831035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.831035] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.831035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.831035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.831035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.831035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.831804] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb768f9a-7df5-400a-9458-4db7712c1e5d is going to be updated. [ 944.831853] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.855813] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.855989] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.856039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.856246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.856393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.856581] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb768f9a-7df5-400a-9458-4db7712c1e5d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.884022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.884022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.884022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.884022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.884022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.884022] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be updated. [ 944.914097] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.914224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.914280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.914491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.914630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.927561] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 945.207031] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.207186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.207186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.207410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.207508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.207602] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 already deleted. [ 945.207685] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.207836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.207991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.208124] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1d9a7ff-d6e8-45b7-a6eb-87684637dd08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.311139] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 480fedb1-b714-4d98-8f62-8eca0ff3855e: rpc.has_security_group_logging(os_id): False [ 945.326600] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.326750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.326822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.327063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.328632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.328632] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.328632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.328632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.328632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.328632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.328632] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.328632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.328632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.328632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.328632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.328632] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.328632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.328632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.329419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.329419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.329419] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be created. [ 945.333794] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.384931] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.385197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.385277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.385494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.385672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.392201] env[69692]: INFO networking_nsxv3.common.synchronization [req-98313fbd-44e0-4456-9b21-4be905c7144b req-821c7c57-2c87-41f4-8abb-2aa24471cae9 tempest-ServerMetadataTestJSON-101117495 tempest-ServerMetadataTestJSON-101117495-project-member] Enqueued Resource ID: cf53673e-0676-4fd1-a46f-53f1c3572abd with Priority: HIGHEST for action security_group_members [ 945.392448] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf53673e-0676-4fd1-a46f-53f1c3572abd with Priority: HIGHEST for action security_group_members [ 945.393082] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf53673e-0676-4fd1-a46f-53f1c3572abd taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.393253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.393359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.393710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.393913] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.394053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.394167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.394355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.394491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.394621] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf53673e-0676-4fd1-a46f-53f1c3572abd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.399142] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 945.731161] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.731327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.731392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.731558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.731695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.731814] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 already deleted. [ 945.731871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.836267] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.836433] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.836507] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.836858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.836858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.836968] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 is going to be created. [ 945.858468] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.858645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.858699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.858951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.859027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.867149] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 in Status: UNINITIALIZED for 2s [ 945.897721] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.897890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.897992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.898553] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.898651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.898845] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.898945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.899016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.899229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.899324] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.899437] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf53673e-0676-4fd1-a46f-53f1c3572abd already deleted. [ 945.899567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.946922] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-546 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.947155] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-546" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.947290] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-546" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.947641] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-546" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.947900] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.948239] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.948390] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.948623] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.948784] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.949016] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.949144] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.949259] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.949381] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.949495] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.949604] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.949816] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.968368] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.968526] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 945.968660] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.968833] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-546" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.969141] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-8b3f4f6b-7258-45d9-833b-0e83f2885660 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.969312] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-8b3f4f6b-7258-45d9-833b-0e83f2885660" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.969431] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-8b3f4f6b-7258-45d9-833b-0e83f2885660" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.969736] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-8b3f4f6b-7258-45d9-833b-0e83f2885660" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.969911] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b3f4f6b-7258-45d9-833b-0e83f2885660',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.481048] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.481048] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.481048] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.481048] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.481048] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.481048] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 8b3f4f6b-7258-45d9-833b-0e83f2885660 not found, creating... [ 946.481048] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.481048] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.481048] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.481048] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.481048] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.481670] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.481670] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.481670] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.481670] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.481670] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.481670] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 8b3f4f6b-7258-45d9-833b-0e83f2885660 is going to be created. [ 946.500911] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.501349] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.501594] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.502344] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.502344] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.502496] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-8b3f4f6b-7258-45d9-833b-0e83f2885660" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.940308] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 946.940538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.940704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.940917] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.941121] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.941244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.941310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.941470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.941550] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.941642] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.252529] env[69692]: INFO networking_nsxv3.common.synchronization [req-98313fbd-44e0-4456-9b21-4be905c7144b req-45046590-9913-4158-b439-fe03db28bdba service nova] Enqueued Resource ID: cf53673e-0676-4fd1-a46f-53f1c3572abd with Priority: HIGHEST for action security_group_rules [ 947.252724] env[69692]: INFO networking_nsxv3.common.synchronization [req-98313fbd-44e0-4456-9b21-4be905c7144b req-45046590-9913-4158-b439-fe03db28bdba service nova] Enqueued Resource ID: cf53673e-0676-4fd1-a46f-53f1c3572abd with Priority: HIGHEST for action security_group_members [ 947.252865] env[69692]: INFO networking_nsxv3.common.synchronization [req-98313fbd-44e0-4456-9b21-4be905c7144b req-45046590-9913-4158-b439-fe03db28bdba service nova] Enqueued Resource ID: 8b3f4f6b-7258-45d9-833b-0e83f2885660 with Priority: HIGHEST for action port [ 947.253392] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf53673e-0676-4fd1-a46f-53f1c3572abd with Priority: HIGHEST for action security_group_rules [ 947.253527] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf53673e-0676-4fd1-a46f-53f1c3572abd with Priority: HIGHEST for action security_group_members [ 947.253626] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b3f4f6b-7258-45d9-833b-0e83f2885660 with Priority: HIGHEST for action port [ 947.256061] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf53673e-0676-4fd1-a46f-53f1c3572abd taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.258050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.258208] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.258531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.258626] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf53673e-0676-4fd1-a46f-53f1c3572abd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.259985] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf53673e-0676-4fd1-a46f-53f1c3572abd taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.259985] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.259985] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.260165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.260165] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.260261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.260326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.260465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.260546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.260654] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf53673e-0676-4fd1-a46f-53f1c3572abd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.262132] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b3f4f6b-7258-45d9-833b-0e83f2885660 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.263050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b3f4f6b-7258-45d9-833b-0e83f2885660" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.263050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b3f4f6b-7258-45d9-833b-0e83f2885660" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.263050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b3f4f6b-7258-45d9-833b-0e83f2885660" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.263050] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b3f4f6b-7258-45d9-833b-0e83f2885660',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.409563] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 947.409930] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.445135] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.445310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.445348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.445588] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.445698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.445858] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.445969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.446037] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.446173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.446250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.446337] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be updated. [ 947.488355] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.488355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.488355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.488355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.488355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.499503] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 947.765522] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf53673e-0676-4fd1-a46f-53f1c3572abd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.766668] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf53673e-0676-4fd1-a46f-53f1c3572abd taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.766800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.766990] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b3f4f6b-7258-45d9-833b-0e83f2885660 with status ACTIVE [ 947.767234] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.767335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.767440] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.767649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.767780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.768014] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.768199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.768199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.768411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.768493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.768728] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.768854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.768911] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.769098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.769203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.769302] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b3f4f6b-7258-45d9-833b-0e83f2885660 is going to be updated. [ 947.789262] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.789420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.789420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.789622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.789785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.790062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b3f4f6b-7258-45d9-833b-0e83f2885660" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.878878] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 in Status: SUCCESS [ 947.878878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.879046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.879237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.879400] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.879522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.879583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.879833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.879932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.880124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.880124] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.271409] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf53673e-0676-4fd1-a46f-53f1c3572abd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.382034] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.735011] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.735620] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.735620] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.735620] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.736115] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.736115] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.736115] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.736329] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.736476] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.736687] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.736845] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.737151] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.737151] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.737800] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.737800] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.737800] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.755240] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.755412] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 948.755558] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.755735] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.756084] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-b173074e-8ee9-458f-8c26-64dec7000a04 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.756306] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.756462] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.756778] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.756936] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b173074e-8ee9-458f-8c26-64dec7000a04',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.774169] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.774315] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.774384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.774594] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.774677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.774773] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf53673e-0676-4fd1-a46f-53f1c3572abd is going to be created. [ 948.795943] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.796107] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.796184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.796388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.796578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.804865] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf53673e-0676-4fd1-a46f-53f1c3572abd in Status: UNINITIALIZED for 2s [ 948.884587] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4: rpc.has_security_group_logging(os_id): False [ 948.904025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.904025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.904025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.904255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.904372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.904614] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.904711] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.904802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.904969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.905080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.905147] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 is going to be created. [ 948.972876] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.973040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.973139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.973327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.973513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.982769] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 in Status: IN_PROGRESS for 2s [ 949.261349] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.263231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.263231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.263231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.263231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.263231] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.263231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.263231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.263231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.263231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.263559] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.263671] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.263875] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.264120] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.264273] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.264399] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: b173074e-8ee9-458f-8c26-64dec7000a04 is going to be updated. [ 949.284553] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.284681] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.284758] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.285022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.285190] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.285410] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.507379] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 949.507555] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 deletion is rescheduled due to dependency. [ 949.507673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.507822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.508057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.508247] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.508404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.508525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.508695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.508776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.508867] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.508976] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.012413] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.012948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.012948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.012948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.013129] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.013237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.013303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.013443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.013549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.013640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.013810] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.013925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.014085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.014161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.014325] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.014429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.014509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.014723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.014723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.014920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.014920] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.283170] env[69692]: INFO networking_nsxv3.common.synchronization [req-a85f2370-ad5a-4f02-a8d5-9b67baaade31 req-8d5d8a09-6b78-4a19-b696-d49b0495e145 service nova] Enqueued Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_rules [ 950.283374] env[69692]: INFO networking_nsxv3.common.synchronization [req-a85f2370-ad5a-4f02-a8d5-9b67baaade31 req-8d5d8a09-6b78-4a19-b696-d49b0495e145 service nova] Enqueued Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_members [ 950.283540] env[69692]: INFO networking_nsxv3.common.synchronization [req-a85f2370-ad5a-4f02-a8d5-9b67baaade31 req-8d5d8a09-6b78-4a19-b696-d49b0495e145 service nova] Enqueued Resource ID: b173074e-8ee9-458f-8c26-64dec7000a04 with Priority: HIGHEST for action port [ 950.287131] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_rules [ 950.287342] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_members [ 950.287456] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b173074e-8ee9-458f-8c26-64dec7000a04 with Priority: HIGHEST for action port [ 950.288272] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-859b640d-3815-457c-8a5b-e9eee00dbcee taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.288409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.288479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.288696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.288778] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.289645] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-859b640d-3815-457c-8a5b-e9eee00dbcee taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.289771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.289860] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.290071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.290346] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.290449] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.290513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.290660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.290745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.290839] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.293380] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-b173074e-8ee9-458f-8c26-64dec7000a04 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.293501] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.293554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.293705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.293780] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b173074e-8ee9-458f-8c26-64dec7000a04',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.517288] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9: rpc.has_security_group_logging(os_id): False [ 950.535749] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.536042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.536042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.536232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.536317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.536531] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.536628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.536746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.536918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.537036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.537276] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.537409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.537510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.537721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.537880] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.538141] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.538299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.538332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.538462] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.538758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.538823] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be updated. [ 950.610387] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.610607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.610658] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.610901] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.611165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.625661] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: IN_PROGRESS for 2s [ 950.795901] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-859b640d-3815-457c-8a5b-e9eee00dbcee taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.795901] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.796242] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.804272] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b173074e-8ee9-458f-8c26-64dec7000a04 with status ACTIVE [ 950.804272] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.804496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.804496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.804639] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.804724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.804897] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.805009] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.805081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.805234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.805301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.805485] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.805577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.805650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.805855] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.805943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.806069] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b173074e-8ee9-458f-8c26-64dec7000a04 is going to be updated. [ 950.817721] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf53673e-0676-4fd1-a46f-53f1c3572abd in Status: SUCCESS [ 950.817957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.818144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.818359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.818555] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.818686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.818764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.818964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.819064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.819176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.819278] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf53673e-0676-4fd1-a46f-53f1c3572abd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.829799] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.829986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.830073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.830225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.830353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.830500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b173074e-8ee9-458f-8c26-64dec7000a04" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.995477] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 in Status: SUCCESS [ 950.995477] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.298510] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.321250] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf53673e-0676-4fd1-a46f-53f1c3572abd taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.321414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.321485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.321694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.321928] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.322040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.322106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.322261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.322346] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.322435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.322797] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf53673e-0676-4fd1-a46f-53f1c3572abd taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.322902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.322963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.323133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.323255] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.323345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.323436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.323532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.323675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.323675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.323766] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf53673e-0676-4fd1-a46f-53f1c3572abd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.800814] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.800987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.801093] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.801311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.801407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.801770] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 859b640d-3815-457c-8a5b-e9eee00dbcee is going to be updated. [ 951.825707] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf53673e-0676-4fd1-a46f-53f1c3572abd: rpc.has_security_group_logging(os_id): False [ 951.829141] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.829288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.829365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.829561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.829700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.837239] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 859b640d-3815-457c-8a5b-e9eee00dbcee in Status: IN_PROGRESS for 2s [ 951.841064] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.841256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.841313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.841488] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.841577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.841831] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.841965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.842062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.842161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.842253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.842432] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.842525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.842584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.842734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.842819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.843546] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.843677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.843726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.843869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.843949] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.844073] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf53673e-0676-4fd1-a46f-53f1c3572abd is going to be created. [ 951.896627] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.896825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.896930] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.897167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.897404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.908613] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf53673e-0676-4fd1-a46f-53f1c3572abd in Status: IN_PROGRESS for 2s [ 952.650061] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 in Status: SUCCESS [ 952.650344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.826025] env[69692]: INFO networking_nsxv3.common.synchronization [req-ee63d22d-5b23-41fc-8dad-4484d3d4b83b req-c242d656-3afe-401b-9fb2-31cd3b65e92d tempest-ServersV294TestFqdnHostnames-879312321 tempest-ServersV294TestFqdnHostnames-879312321-project-member] Enqueued Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGHEST for action security_group_members [ 953.826308] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGHEST for action security_group_members [ 953.826599] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.826731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.826800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.827068] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.827245] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.827349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.827412] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.827563] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.827648] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.827738] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e7c8a7-d992-42fb-849a-a4f4ddc2f188',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.847698] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 859b640d-3815-457c-8a5b-e9eee00dbcee in Status: SUCCESS [ 953.847883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.848051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.848356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.848558] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.848682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.848764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.849053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.849156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.849246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.849340] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.920249] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf53673e-0676-4fd1-a46f-53f1c3572abd in Status: SUCCESS [ 953.920249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.245111] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.245111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-57" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.245111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-57" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.245111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-57" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.245111] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.245111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.245111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.251167] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.251167] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.251167] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.251296] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.251420] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.251505] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.251637] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.251758] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.251923] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.272093] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.273333] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 954.273333] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.273333] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-57" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.273333] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-10e591a2-535b-4ae6-8bbb-93231da8f969 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.273333] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-10e591a2-535b-4ae6-8bbb-93231da8f969" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.273613] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-10e591a2-535b-4ae6-8bbb-93231da8f969" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.273764] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-10e591a2-535b-4ae6-8bbb-93231da8f969" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.273910] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10e591a2-535b-4ae6-8bbb-93231da8f969',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.333022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.333022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.333022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.333022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.333022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.333022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.333022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.333022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.333022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.333022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.333022] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 already deleted. [ 954.333022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.352227] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.776690] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.776996] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.777155] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.777533] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.777747] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.777932] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 10e591a2-535b-4ae6-8bbb-93231da8f969 not found, creating... [ 954.778316] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.778556] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.778729] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.780380] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.780733] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.781185] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.781470] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.781688] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.782193] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.782493] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.782724] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 10e591a2-535b-4ae6-8bbb-93231da8f969 is going to be created. [ 954.802846] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.803038] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.803085] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.803507] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.803768] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.804408] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-10e591a2-535b-4ae6-8bbb-93231da8f969" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.858104] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 859b640d-3815-457c-8a5b-e9eee00dbcee: rpc.has_security_group_logging(os_id): False [ 954.876555] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.876555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.876675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.876874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.902224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.902450] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.902576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.902645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.902849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.902941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.903052] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 859b640d-3815-457c-8a5b-e9eee00dbcee is going to be updated. [ 954.972744] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.972977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.972977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.973181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.973335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.985337] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 859b640d-3815-457c-8a5b-e9eee00dbcee in Status: IN_PROGRESS for 2s [ 955.631393] env[69692]: INFO networking_nsxv3.common.synchronization [req-ee63d22d-5b23-41fc-8dad-4484d3d4b83b req-e1aeaaaa-0ea7-488f-bb89-ff89f3f4a40a service nova] Enqueued Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGHEST for action security_group_rules [ 955.631601] env[69692]: INFO networking_nsxv3.common.synchronization [req-ee63d22d-5b23-41fc-8dad-4484d3d4b83b req-e1aeaaaa-0ea7-488f-bb89-ff89f3f4a40a service nova] Enqueued Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGHEST for action security_group_members [ 955.631746] env[69692]: INFO networking_nsxv3.common.synchronization [req-ee63d22d-5b23-41fc-8dad-4484d3d4b83b req-e1aeaaaa-0ea7-488f-bb89-ff89f3f4a40a service nova] Enqueued Resource ID: 10e591a2-535b-4ae6-8bbb-93231da8f969 with Priority: HIGHEST for action port [ 955.632370] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGHEST for action security_group_rules [ 955.632539] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGHEST for action security_group_members [ 955.632644] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e591a2-535b-4ae6-8bbb-93231da8f969 with Priority: HIGHEST for action port [ 955.633093] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.633163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.633210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.633466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.633553] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e7c8a7-d992-42fb-849a-a4f4ddc2f188',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.634996] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.635133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.635203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.635385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.635592] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.635726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.635862] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.636084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.636190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.636300] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e7c8a7-d992-42fb-849a-a4f4ddc2f188',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.637254] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-10e591a2-535b-4ae6-8bbb-93231da8f969 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.637399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10e591a2-535b-4ae6-8bbb-93231da8f969" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.637480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10e591a2-535b-4ae6-8bbb-93231da8f969" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.637659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10e591a2-535b-4ae6-8bbb-93231da8f969" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.637786] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10e591a2-535b-4ae6-8bbb-93231da8f969',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.140325] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e7c8a7-d992-42fb-849a-a4f4ddc2f188',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.141404] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.141519] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.141675] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10e591a2-535b-4ae6-8bbb-93231da8f969 with status ACTIVE [ 956.141890] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.142033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.142102] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.142330] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.142394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.142568] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.142657] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.142718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.143035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.143124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.143314] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.143415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.143477] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.143630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.143703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.143786] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10e591a2-535b-4ae6-8bbb-93231da8f969 is going to be updated. [ 956.165753] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.166185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.166185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.166283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.166404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.166734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10e591a2-535b-4ae6-8bbb-93231da8f969" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.646748] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e7c8a7-d992-42fb-849a-a4f4ddc2f188',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.001535] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 859b640d-3815-457c-8a5b-e9eee00dbcee in Status: SUCCESS [ 957.001954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.149901] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.150407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.150505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.150736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.150869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.150988] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 is going to be created. [ 957.176652] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.176815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.178382] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.178711] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.178916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.191998] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 in Status: UNINITIALIZED for 2s [ 959.155413] env[69692]: INFO networking_nsxv3.common.synchronization [req-abc43bc3-5a21-45d1-b37b-f124f1341349 req-bc048581-653b-4792-9a70-29614f4806f3 tempest-ServerActionsV293TestJSON-586801738 tempest-ServerActionsV293TestJSON-586801738-project-member] Enqueued Resource ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a with Priority: HIGHEST for action security_group_members [ 959.156529] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a with Priority: HIGHEST for action security_group_members [ 959.160436] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.160436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.160436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.160436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.160436] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.160436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.160436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.160436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.160436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.160436] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.212123] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 in Status: SUCCESS [ 959.212384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.212566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.212792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.213046] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.213175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.213243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.213364] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.213449] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.213644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.213765] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68e7c8a7-d992-42fb-849a-a4f4ddc2f188',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.664048] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.664048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.664048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.664295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.664295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.664400] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.664514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.664579] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.664766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.665100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.665100] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a is going to be updated. [ 959.693327] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.693327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.693327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.693529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.694554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.705772] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a in Status: IN_PROGRESS for 2s [ 959.716940] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68e7c8a7-d992-42fb-849a-a4f4ddc2f188',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.219611] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68e7c8a7-d992-42fb-849a-a4f4ddc2f188: rpc.has_security_group_logging(os_id): False [ 960.250516] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.250658] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.250726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.251121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.251121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.251297] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.251420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.251456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.251602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.251669] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.251749] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 is going to be created. [ 960.325246] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.325246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.325246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.325246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.325246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.337471] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 in Status: IN_PROGRESS for 2s [ 960.734153] env[69692]: INFO networking_nsxv3.common.synchronization [req-3a9778c5-309b-4b3d-9dfb-73b87074f59b req-3a854a8b-781d-4f06-bf42-8b3f9af2d95a tempest-ServerMetadataTestJSON-101117495 tempest-ServerMetadataTestJSON-101117495-project-member] Enqueued Resource ID: cf53673e-0676-4fd1-a46f-53f1c3572abd with Priority: HIGHEST for action security_group_members [ 960.734810] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf53673e-0676-4fd1-a46f-53f1c3572abd with Priority: HIGHEST for action security_group_members [ 960.735695] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf53673e-0676-4fd1-a46f-53f1c3572abd taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.735791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.735994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.736168] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.736341] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.736448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.736522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.736843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.736843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.736954] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf53673e-0676-4fd1-a46f-53f1c3572abd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.853831] env[69692]: INFO networking_nsxv3.common.synchronization [req-7900b292-5dce-49d9-841a-171501657dc2 req-c97f57c1-030c-48b0-a8ba-f7fead4aec07 tempest-DeleteServersTestJSON-207338121 tempest-DeleteServersTestJSON-207338121-project-member] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 960.854676] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 960.855043] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.855170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.855234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.855441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.855595] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.855693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.855752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.856444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.856444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.856444] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.240602] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.240894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.240894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.241057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.241156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.241355] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.241472] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.241534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.241695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.241773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.241937] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf53673e-0676-4fd1-a46f-53f1c3572abd is going to be updated. [ 961.271072] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.271219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.271291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.271498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.271642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.280616] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf53673e-0676-4fd1-a46f-53f1c3572abd in Status: IN_PROGRESS for 2s [ 961.359102] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.359483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.359483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.359605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.359655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.359849] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.361113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.361113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.361113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.361113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.361113] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 961.384607] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.384821] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.384927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.385251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.385464] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.395455] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 961.515095] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.515321] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.515945] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.515945] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.521121] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.521121] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.521121] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.521350] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.521385] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.521665] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.521803] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.521948] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.522078] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.522194] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.522300] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.522445] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.544977] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.545189] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 961.545386] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.545653] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.546103] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-cb048997-7233-4f02-ac6c-af45f75c9346 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.546375] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-cb048997-7233-4f02-ac6c-af45f75c9346" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.546510] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-cb048997-7233-4f02-ac6c-af45f75c9346" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.546954] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-cb048997-7233-4f02-ac6c-af45f75c9346" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.547192] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb048997-7233-4f02-ac6c-af45f75c9346',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.716897] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a in Status: SUCCESS [ 961.717457] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a deletion is rescheduled due to dependency. [ 961.717457] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.833504] env[69692]: INFO networking_nsxv3.common.synchronization [req-918b724d-aa23-4756-95b0-e4f70f36dc75 req-0e986cb2-46be-43b8-952c-2ef9df3526ca tempest-MigrationsAdminTest-1006177328 tempest-MigrationsAdminTest-1006177328-project-member] Enqueued Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_members [ 961.834023] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGHEST for action security_group_members [ 961.834361] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.834495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.834602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.834958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.835162] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.835266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.835332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.835544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.835589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.835683] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.844792] env[69692]: INFO networking_nsxv3.common.synchronization [req-e4179c5e-c564-4e6a-a086-c740ecef4085 req-1c5549c7-eaf5-491c-b946-dc263721f841 tempest-ServersAdminTestJSON-1982348900 tempest-ServersAdminTestJSON-1982348900-project-member] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 961.846434] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 961.846434] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.846434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.846434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.846434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.848028] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.848028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.848028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.848028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.848028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.848028] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.050585] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.050937] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.051170] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.051568] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.051787] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.052055] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port cb048997-7233-4f02-ac6c-af45f75c9346 not found, creating... [ 962.052426] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.052657] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.052843] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.053197] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.053411] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.053846] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.054101] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.054289] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.054586] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.054796] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.055013] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: cb048997-7233-4f02-ac6c-af45f75c9346 is going to be created. [ 962.079283] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.079283] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.079283] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.079283] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.079283] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.079521] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-cb048997-7233-4f02-ac6c-af45f75c9346" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.341966] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.341966] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.341966] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.341966] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.355366] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.357104] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 in Status: SUCCESS [ 962.357973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.363549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.364085] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.364646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.364841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.365160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.365337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.365503] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803064c7-17f8-46ee-bdf3-20357514c794 is going to be updated. [ 962.393221] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.393358] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.393429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.393637] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.393774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.409983] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: IN_PROGRESS for 2s [ 962.858792] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.941445] env[69692]: INFO networking_nsxv3.common.synchronization [req-7900b292-5dce-49d9-841a-171501657dc2 req-b6b45dac-6428-4830-9812-312bdf117e3d service nova] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_rules [ 962.941445] env[69692]: INFO networking_nsxv3.common.synchronization [req-7900b292-5dce-49d9-841a-171501657dc2 req-b6b45dac-6428-4830-9812-312bdf117e3d service nova] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 962.941445] env[69692]: INFO networking_nsxv3.common.synchronization [req-7900b292-5dce-49d9-841a-171501657dc2 req-b6b45dac-6428-4830-9812-312bdf117e3d service nova] Enqueued Resource ID: cb048997-7233-4f02-ac6c-af45f75c9346 with Priority: HIGHEST for action port [ 962.941445] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_rules [ 962.941445] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 962.941597] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb048997-7233-4f02-ac6c-af45f75c9346 with Priority: HIGHEST for action port [ 962.942441] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.942540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.942674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.942841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.942935] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.947447] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.947540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.947862] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb048997-7233-4f02-ac6c-af45f75c9346 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.947990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb048997-7233-4f02-ac6c-af45f75c9346" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.948092] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb048997-7233-4f02-ac6c-af45f75c9346" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.948344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb048997-7233-4f02-ac6c-af45f75c9346" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.948446] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb048997-7233-4f02-ac6c-af45f75c9346',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.294023] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf53673e-0676-4fd1-a46f-53f1c3572abd in Status: SUCCESS [ 963.294023] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf53673e-0676-4fd1-a46f-53f1c3572abd deletion is rescheduled due to dependency. [ 963.294023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.362560] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.362560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.362560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.362560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.362560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.362560] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 963.401750] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.401927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.402020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.402230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.402378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.407600] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 963.407766] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 deletion is rescheduled due to dependency. [ 963.407872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.408047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.408299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.408562] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.408697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.408765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.408933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.409015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.409113] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.410557] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 963.450727] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.450821] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.451051] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb048997-7233-4f02-ac6c-af45f75c9346 with status ACTIVE [ 963.451378] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.451378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.451378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.451617] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.451703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.452259] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.452259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.452259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.452422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.452422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.456044] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.456044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.456044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.456044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.456044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.456044] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb048997-7233-4f02-ac6c-af45f75c9346 is going to be updated. [ 963.480152] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.480263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.480299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.480877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.480877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.480877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb048997-7233-4f02-ac6c-af45f75c9346" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.912345] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.418304] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.420988] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 803064c7-17f8-46ee-bdf3-20357514c794 in Status: SUCCESS [ 964.421172] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 803064c7-17f8-46ee-bdf3-20357514c794 deletion is rescheduled due to dependency. [ 964.421305] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.920900] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.921100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.921139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.921350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.921626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.921626] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 964.948618] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.948870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.948944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.949278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.949742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.958339] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 965.421743] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 965.422903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.968419] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 966.968831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.968831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.969078] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.969280] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.969401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.969456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.969620] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.969723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.969861] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.969992] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.063357] env[69692]: INFO networking_nsxv3.common.synchronization [req-ca241077-4b9f-4aea-91d9-3c66d80753a8 req-dc23298e-3807-4531-bcf8-a4c15441b27b tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 967.063958] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 967.064640] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.064790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.064860] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.065090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.065953] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.065953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.065953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.065953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.066201] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.066201] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.417485] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.417742] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.417991] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.418345] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.418693] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.418895] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.419141] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.419470] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.419775] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.420110] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.420286] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.420472] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.420634] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.420786] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.420968] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.421186] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.440465] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.440679] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 967.440868] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.441091] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.441481] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-7d8245d8-1a0b-4147-ad80-4cd1996d69e7 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.441677] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-7d8245d8-1a0b-4147-ad80-4cd1996d69e7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.441812] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-7d8245d8-1a0b-4147-ad80-4cd1996d69e7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.442221] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-7d8245d8-1a0b-4147-ad80-4cd1996d69e7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.442389] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d8245d8-1a0b-4147-ad80-4cd1996d69e7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.471980] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.472183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.472254] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.472489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.472668] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.472761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.472824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.472989] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.473084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.474028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.474028] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.474028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.474028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.474028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.474028] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.474028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.474028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.474028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.474435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.474435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.474435] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.568705] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.568906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.568970] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.569233] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.593347] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.595179] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.595179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.595179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.595179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.595179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.595179] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 967.632348] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.632348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.632348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.632348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.632348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.642714] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 967.945281] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.945532] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.945689] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.946026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.946205] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.946392] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 7d8245d8-1a0b-4147-ad80-4cd1996d69e7 not found, creating... [ 967.946680] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.946885] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.947049] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.947300] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.947467] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.947760] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.947926] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.948088] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.948283] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.948439] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.948562] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 7d8245d8-1a0b-4147-ad80-4cd1996d69e7 is going to be created. [ 967.969029] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.969338] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.969418] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.969814] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.970168] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.970479] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-7d8245d8-1a0b-4147-ad80-4cd1996d69e7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.977151] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 532815ef-03c8-40fb-91ab-292fc1c769b2: rpc.has_security_group_logging(os_id): False [ 967.997516] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.997674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.997751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.997970] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.998083] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.998326] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.998423] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.998486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.998643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.998723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.998902] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.998996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.999076] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.999223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.999300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.999480] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.999572] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.999636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.999784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.999874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.999978] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 968.085506] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.085682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.085753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.085988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.086161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.112116] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 968.682554] env[69692]: INFO networking_nsxv3.common.synchronization [req-ca241077-4b9f-4aea-91d9-3c66d80753a8 req-7dc9161f-1c29-4f3d-8a36-f1285f927dea service nova] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_rules [ 968.682681] env[69692]: INFO networking_nsxv3.common.synchronization [req-ca241077-4b9f-4aea-91d9-3c66d80753a8 req-7dc9161f-1c29-4f3d-8a36-f1285f927dea service nova] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 968.682828] env[69692]: INFO networking_nsxv3.common.synchronization [req-ca241077-4b9f-4aea-91d9-3c66d80753a8 req-7dc9161f-1c29-4f3d-8a36-f1285f927dea service nova] Enqueued Resource ID: 7d8245d8-1a0b-4147-ad80-4cd1996d69e7 with Priority: HIGHEST for action port [ 968.683075] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_rules [ 968.683201] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 968.683337] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d8245d8-1a0b-4147-ad80-4cd1996d69e7 with Priority: HIGHEST for action port [ 968.683860] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.684355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.684435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.684640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.684736] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.685573] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.685682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.685850] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d8245d8-1a0b-4147-ad80-4cd1996d69e7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.685948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d8245d8-1a0b-4147-ad80-4cd1996d69e7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.686027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d8245d8-1a0b-4147-ad80-4cd1996d69e7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.686201] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d8245d8-1a0b-4147-ad80-4cd1996d69e7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.686297] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d8245d8-1a0b-4147-ad80-4cd1996d69e7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.187608] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.187973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.187973] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d8245d8-1a0b-4147-ad80-4cd1996d69e7 with status ACTIVE [ 969.188178] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.188286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.188348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.188577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.188681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.188866] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.188964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.189041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.189762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.189762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.189762] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.189762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.189762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.189762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.189992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.189992] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d8245d8-1a0b-4147-ad80-4cd1996d69e7 is going to be updated. [ 969.217364] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.217528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.217643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.217857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.218075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.218191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d8245d8-1a0b-4147-ad80-4cd1996d69e7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.651586] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 969.651802] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b deletion is rescheduled due to dependency. [ 969.651909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.652213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.652500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.652695] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.652806] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.652881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.653095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.653203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.653329] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.128784] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 970.128784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.156083] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.458035] env[69692]: INFO networking_nsxv3.common.synchronization [req-a0127245-b898-4471-a770-d2caac847eea req-de1e7817-05c1-4462-abec-9ed60388b07c tempest-ImagesTestJSON-510458365 tempest-ImagesTestJSON-510458365-project-member] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 970.458676] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 970.459059] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.459248] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.459371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.459631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.459873] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.460058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.460173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.460376] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.460598] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.460677] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.659900] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.962985] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.963192] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.963192] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.963405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.963519] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.963714] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.963811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.963879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.964112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.964205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.964326] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 970.990222] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.990376] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.990455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.990626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.990800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.998483] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 971.163146] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.163146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.163146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.163146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.163373] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.163373] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 971.199213] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.199417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.199417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.200198] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.200198] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.207789] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 973.010984] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 973.011274] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e deletion is rescheduled due to dependency. [ 973.011274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.217459] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 973.218113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.218113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.218113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.218269] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.218330] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.218396] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.218547] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.218624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.218714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.218790] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.569372] env[69692]: INFO networking_nsxv3.common.synchronization [None req-9bc031db-872d-4235-a602-6216ad504970 tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 973.569372] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 973.569372] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.569372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.569372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.569630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.570674] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.570674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.570674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.570674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.570889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.570987] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.722021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.722591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.074162] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.575275] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.077080] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.077401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.077401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.077539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.077630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.077727] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 975.106349] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.106575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.106575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.106770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.106909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.114909] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 975.662664] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.664024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.664024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.664024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.664024] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.664024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.664351] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.664388] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.664530] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.664744] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.664863] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.664977] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.665104] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.665221] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.665332] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.665466] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 975.683097] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 975.683237] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 975.683354] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 975.683489] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.683812] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-7356d1e6-e96f-4cdb-b17c-2ad607ca1523 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.683989] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-7356d1e6-e96f-4cdb-b17c-2ad607ca1523" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.684117] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-7356d1e6-e96f-4cdb-b17c-2ad607ca1523" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.685256] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-7356d1e6-e96f-4cdb-b17c-2ad607ca1523" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.685256] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7356d1e6-e96f-4cdb-b17c-2ad607ca1523',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.187166] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.187559] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.187559] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.187871] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.188018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.188234] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 7356d1e6-e96f-4cdb-b17c-2ad607ca1523 not found, creating... [ 976.188556] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.188726] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.188851] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.189115] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.189251] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.189535] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.189697] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.189828] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.190092] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.190237] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.190386] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 7356d1e6-e96f-4cdb-b17c-2ad607ca1523 is going to be created. [ 976.217558] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.217787] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.217913] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.218302] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.218431] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.218649] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-7356d1e6-e96f-4cdb-b17c-2ad607ca1523" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.223230] env[69692]: INFO networking_nsxv3.common.synchronization [req-20cbe069-2a31-4ae2-97b4-9bfc41f685ee req-d4180940-ec5e-487a-b1d4-eb2b468fb91d tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGHEST for action security_group_members [ 976.223949] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGHEST for action security_group_members [ 976.224299] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.224415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.224476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.228020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.228020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.228020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.228020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.228020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.228020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.228020] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d9a7ff-d6e8-45b7-a6eb-87684637dd08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.727167] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.727167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.727282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.727582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.727703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.727902] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.728042] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.728103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.728211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.728280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.728384] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 already deleted. [ 976.728468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.125552] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.125751] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.126966] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.127307] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.127583] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.127751] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.127871] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.128117] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.128271] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.129087] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.129087] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.129087] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.129087] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.129087] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.129087] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.129438] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.130797] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 4s [ 977.146874] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.147096] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 977.147264] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.147445] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.148198] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-e52219fe-1cfe-4a6d-a589-a134400c6c3a taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.148198] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-e52219fe-1cfe-4a6d-a589-a134400c6c3a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.148198] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-e52219fe-1cfe-4a6d-a589-a134400c6c3a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.150198] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-e52219fe-1cfe-4a6d-a589-a134400c6c3a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.150198] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e52219fe-1cfe-4a6d-a589-a134400c6c3a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.236528] env[69692]: INFO networking_nsxv3.common.synchronization [req-ff016496-fa73-46ab-96f7-b650725d770f req-9907a4dc-1153-40ef-a216-b49991e22641 service nova] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_rules [ 977.236528] env[69692]: INFO networking_nsxv3.common.synchronization [req-ff016496-fa73-46ab-96f7-b650725d770f req-9907a4dc-1153-40ef-a216-b49991e22641 service nova] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 977.236773] env[69692]: INFO networking_nsxv3.common.synchronization [req-ff016496-fa73-46ab-96f7-b650725d770f req-9907a4dc-1153-40ef-a216-b49991e22641 service nova] Enqueued Resource ID: 7356d1e6-e96f-4cdb-b17c-2ad607ca1523 with Priority: HIGHEST for action port [ 977.236805] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_rules [ 977.236981] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 977.237038] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7356d1e6-e96f-4cdb-b17c-2ad607ca1523 with Priority: HIGHEST for action port [ 977.237561] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.237661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.237859] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.237938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.238162] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-7356d1e6-e96f-4cdb-b17c-2ad607ca1523 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.238270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7356d1e6-e96f-4cdb-b17c-2ad607ca1523" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.238332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7356d1e6-e96f-4cdb-b17c-2ad607ca1523" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.238530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7356d1e6-e96f-4cdb-b17c-2ad607ca1523" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.238605] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7356d1e6-e96f-4cdb-b17c-2ad607ca1523',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.603139] env[69692]: INFO networking_nsxv3.common.synchronization [None req-d84a5d07-a692-4001-9c0f-de650e304eaa None None] Enqueued Resource ID: 6a9b6379-f986-401f-814a-90bf6ea5d8dc with Priority: HIGHEST for action port [ 977.603414] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a9b6379-f986-401f-814a-90bf6ea5d8dc with Priority: HIGHEST for action port [ 977.604096] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a9b6379-f986-401f-814a-90bf6ea5d8dc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.604096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a9b6379-f986-401f-814a-90bf6ea5d8dc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.604238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a9b6379-f986-401f-814a-90bf6ea5d8dc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.604528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a9b6379-f986-401f-814a-90bf6ea5d8dc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.604619] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a9b6379-f986-401f-814a-90bf6ea5d8dc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.652100] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.652467] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.652660] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.653144] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.653353] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.653578] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port e52219fe-1cfe-4a6d-a589-a134400c6c3a not found, creating... [ 977.653798] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.653965] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.654101] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.654363] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.654513] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.654813] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.654972] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.655107] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.655798] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.655798] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.655798] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: e52219fe-1cfe-4a6d-a589-a134400c6c3a is going to be created. [ 977.676910] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.677170] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.677321] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.677549] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.677780] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.678014] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-e52219fe-1cfe-4a6d-a589-a134400c6c3a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.739927] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7356d1e6-e96f-4cdb-b17c-2ad607ca1523 with status ACTIVE [ 977.740183] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.740468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.740468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.740586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.740675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.740848] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.740948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.741023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.741178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.741255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.741506] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.741593] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.741593] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.741717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.741790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.741873] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7356d1e6-e96f-4cdb-b17c-2ad607ca1523 is going to be updated. [ 977.763206] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.763357] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.763430] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.763629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.763760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.763916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7356d1e6-e96f-4cdb-b17c-2ad607ca1523" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.109064] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a9b6379-f986-401f-814a-90bf6ea5d8dc [ 978.109064] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.109064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.109064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.109064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.109064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.109064] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a9b6379-f986-401f-814a-90bf6ea5d8dc already deleted. [ 978.109064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a9b6379-f986-401f-814a-90bf6ea5d8dc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.659156] env[69692]: INFO networking_nsxv3.common.synchronization [req-20cbe069-2a31-4ae2-97b4-9bfc41f685ee req-c591a728-500d-4991-a2f2-d1435c38e6ba service nova] Enqueued Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGHEST for action security_group_rules [ 978.659422] env[69692]: INFO networking_nsxv3.common.synchronization [req-20cbe069-2a31-4ae2-97b4-9bfc41f685ee req-c591a728-500d-4991-a2f2-d1435c38e6ba service nova] Enqueued Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGHEST for action security_group_members [ 978.659460] env[69692]: INFO networking_nsxv3.common.synchronization [req-20cbe069-2a31-4ae2-97b4-9bfc41f685ee req-c591a728-500d-4991-a2f2-d1435c38e6ba service nova] Enqueued Resource ID: e52219fe-1cfe-4a6d-a589-a134400c6c3a with Priority: HIGHEST for action port [ 978.659666] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGHEST for action security_group_rules [ 978.659793] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGHEST for action security_group_members [ 978.659913] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e52219fe-1cfe-4a6d-a589-a134400c6c3a with Priority: HIGHEST for action port [ 978.660488] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.660612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.660680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.660870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.660948] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1d9a7ff-d6e8-45b7-a6eb-87684637dd08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.661889] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.662057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.662164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.662473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.662649] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.662750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.662841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.662958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.663141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.663141] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d9a7ff-d6e8-45b7-a6eb-87684637dd08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.664082] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-e52219fe-1cfe-4a6d-a589-a134400c6c3a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.664195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e52219fe-1cfe-4a6d-a589-a134400c6c3a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.664258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e52219fe-1cfe-4a6d-a589-a134400c6c3a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.664436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e52219fe-1cfe-4a6d-a589-a134400c6c3a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.664508] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e52219fe-1cfe-4a6d-a589-a134400c6c3a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.709879] env[69692]: INFO networking_nsxv3.common.synchronization [None req-bb682331-5052-4c2c-90f1-20afe5636e22 tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_rules [ 978.709879] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_rules [ 978.709879] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.709879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.710121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.710239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.710286] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.936069] env[69692]: INFO networking_nsxv3.common.synchronization [None req-4b363a5a-2858-44db-ae46-eff6117402b4 tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_rules [ 978.937833] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_rules [ 978.937833] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.937833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.143300] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.143300] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.143300] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.143300] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.143300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.143980] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.143980] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.146375] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.146375] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.146375] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.146375] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.146650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.146933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.148108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.148108] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.166046] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.166205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.166388] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1d9a7ff-d6e8-45b7-a6eb-87684637dd08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.167591] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e52219fe-1cfe-4a6d-a589-a134400c6c3a with status ACTIVE [ 979.167591] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.167591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.167591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.167785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.167785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.167868] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.167968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.168041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.168249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.168283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.169534] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.169534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.169534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.169534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.169534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.169534] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e52219fe-1cfe-4a6d-a589-a134400c6c3a is going to be updated. [ 979.188396] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.188592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.188628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.188811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.188948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.189150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e52219fe-1cfe-4a6d-a589-a134400c6c3a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.229778] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.229778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.229778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.229778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.229778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.230041] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 already deleted. [ 979.230041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.230110] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.230207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.230281] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.649363] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0602c86f-34c6-42e5-a101-35f6c95de05b: rpc.has_security_group_logging(os_id): False [ 979.650162] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.668342] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.668342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.668342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.668342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.668342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.668342] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.668903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.668903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.668903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.668903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.669213] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.669584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.670870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.670870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.670870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.670870] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.670870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.670870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.670870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.670870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.670870] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 979.672041] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1d9a7ff-d6e8-45b7-a6eb-87684637dd08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.731566] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.735249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.735249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.735346] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.735493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.752289] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 979.754393] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.754706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.754803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.755051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.755343] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.755343] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 already deleted. [ 979.755451] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.986324] env[69692]: INFO networking_nsxv3.common.synchronization [None req-317df85c-8e69-4115-bad9-0a318738964d None None] Enqueued Resource ID: 2d6a29d9-42a8-4b67-bd40-636a37a33ad6 with Priority: HIGHEST for action port [ 979.987480] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d6a29d9-42a8-4b67-bd40-636a37a33ad6 with Priority: HIGHEST for action port [ 979.988956] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d6a29d9-42a8-4b67-bd40-636a37a33ad6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.989618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d6a29d9-42a8-4b67-bd40-636a37a33ad6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.989618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d6a29d9-42a8-4b67-bd40-636a37a33ad6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.989618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d6a29d9-42a8-4b67-bd40-636a37a33ad6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.989618] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d6a29d9-42a8-4b67-bd40-636a37a33ad6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.152751] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.176298] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.176298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.176298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.176298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.176298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.176298] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 is going to be created. [ 980.190250] env[69692]: INFO networking_nsxv3.common.synchronization [req-93a1a542-a236-48ae-b321-9ec7c4706c15 req-5ff56394-92c9-479f-925c-2c6c72427434 tempest-ServersTestMultiNic-1078791388 tempest-ServersTestMultiNic-1078791388-project-member] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 980.190761] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 980.191077] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.191274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.191339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.192080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.192080] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.192080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.192080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.193258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.193427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.195068] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.203115] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.203474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.203474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.203675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.203879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.213804] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 in Status: UNINITIALIZED for 2s [ 980.492502] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d6a29d9-42a8-4b67-bd40-636a37a33ad6 [ 980.492811] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.493028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.493115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.493340] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.493503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.493675] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d6a29d9-42a8-4b67-bd40-636a37a33ad6 already deleted. [ 980.493778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d6a29d9-42a8-4b67-bd40-636a37a33ad6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.656330] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.656570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.656570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.656863] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.658096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.658096] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 980.693077] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.693077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.693077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.693077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.693077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.699532] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.699532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.699532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.699532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.699532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.699532] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.699532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.699532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.699532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.699532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.699532] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 980.701032] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 980.729037] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.729037] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.729037] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.729439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.729439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.739203] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 980.756152] env[69692]: INFO networking_nsxv3.common.synchronization [req-93a1a542-a236-48ae-b321-9ec7c4706c15 req-56eea6e6-1f07-4050-b7ff-8c0729fb583b tempest-ServersTestMultiNic-1078791388 tempest-ServersTestMultiNic-1078791388-project-member] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 980.756824] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 980.757364] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.757364] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.101828] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-655 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.102091] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-655" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.102251] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-655" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.102620] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-655" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.102915] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.103128] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.103278] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.103538] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.103702] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.103947] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.104108] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.104243] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.104362] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.104493] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.104588] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.104726] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.122863] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.123080] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 981.123244] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.123432] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-655" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.123749] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-18205e73-78e4-4a96-a726-5908aaadbb95 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.123925] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-18205e73-78e4-4a96-a726-5908aaadbb95" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.124062] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-18205e73-78e4-4a96-a726-5908aaadbb95" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.124418] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-18205e73-78e4-4a96-a726-5908aaadbb95" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.124549] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18205e73-78e4-4a96-a726-5908aaadbb95',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.626614] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.626859] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.626976] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.627295] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.627457] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.627619] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 18205e73-78e4-4a96-a726-5908aaadbb95 not found, creating... [ 981.628152] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.628152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.628152] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.628385] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.628525] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.628806] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.628967] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.629123] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.629340] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.629474] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.629613] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 18205e73-78e4-4a96-a726-5908aaadbb95 is going to be created. [ 981.649866] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.650143] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.650280] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.651029] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.651029] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.651029] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-18205e73-78e4-4a96-a726-5908aaadbb95" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.767198] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 981.767519] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.767605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.767832] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.768051] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.226196] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 in Status: SUCCESS [ 982.226196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.226196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.226196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.226196] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.226196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.226196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.226196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.226196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.226196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.226196] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1d9a7ff-d6e8-45b7-a6eb-87684637dd08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.270150] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.270150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.432349] env[69692]: INFO networking_nsxv3.common.synchronization [req-93a1a542-a236-48ae-b321-9ec7c4706c15 req-3d8f6923-30d4-44fb-b53b-b3570897fcbb service nova] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_rules [ 982.432794] env[69692]: INFO networking_nsxv3.common.synchronization [req-93a1a542-a236-48ae-b321-9ec7c4706c15 req-3d8f6923-30d4-44fb-b53b-b3570897fcbb service nova] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 982.432794] env[69692]: INFO networking_nsxv3.common.synchronization [req-93a1a542-a236-48ae-b321-9ec7c4706c15 req-3d8f6923-30d4-44fb-b53b-b3570897fcbb service nova] Enqueued Resource ID: 18205e73-78e4-4a96-a726-5908aaadbb95 with Priority: HIGHEST for action port [ 982.433257] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_rules [ 982.433393] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 982.433493] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18205e73-78e4-4a96-a726-5908aaadbb95 with Priority: HIGHEST for action port [ 982.437685] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.438228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.438987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.439264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.439363] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.442615] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.442615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.442615] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-18205e73-78e4-4a96-a726-5908aaadbb95 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.442615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18205e73-78e4-4a96-a726-5908aaadbb95" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.442615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18205e73-78e4-4a96-a726-5908aaadbb95" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.442615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18205e73-78e4-4a96-a726-5908aaadbb95" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.442615] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18205e73-78e4-4a96-a726-5908aaadbb95',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.714228] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 982.714461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.714631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.714857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.715070] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.716570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.716570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.716570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.716570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.716570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.716570] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.729140] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1d9a7ff-d6e8-45b7-a6eb-87684637dd08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.750193] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 982.750193] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c deletion is rescheduled due to dependency. [ 982.750193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.750193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.750193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.750193] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.750193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.750193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.750193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.750193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.750193] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.942702] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.943213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.944228] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18205e73-78e4-4a96-a726-5908aaadbb95 with status ACTIVE [ 982.944485] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.944680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.944868] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.945111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.945253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.945495] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.945649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.945763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.945986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.946134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.946385] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.946536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.946651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.946856] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.946985] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.947132] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18205e73-78e4-4a96-a726-5908aaadbb95 is going to be updated. [ 982.965545] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.965687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.965773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.965940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.966088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.966249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18205e73-78e4-4a96-a726-5908aaadbb95" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.218450] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.222020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.222020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.222020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.222020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.222744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.222744] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.231085] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1d9a7ff-d6e8-45b7-a6eb-87684637dd08: rpc.has_security_group_logging(os_id): False [ 983.248418] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.248568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.248643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.248855] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.248947] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.249196] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.249296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.249360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.249505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.249582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.249669] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 is going to be created. [ 983.253206] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.263721] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.263953] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-538" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.264132] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-538" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.264408] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-538" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.264699] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.265220] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.265220] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.265220] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.265625] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.265625] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.265698] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.265745] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.265858] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.265968] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.266095] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.266233] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.286229] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.286229] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 983.286229] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.286229] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-538" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.286229] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-e2cb1e28-3eff-48f9-865e-14c17e13b8cb taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.286229] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-e2cb1e28-3eff-48f9-865e-14c17e13b8cb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.286529] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-e2cb1e28-3eff-48f9-865e-14c17e13b8cb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.287235] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-e2cb1e28-3eff-48f9-865e-14c17e13b8cb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.287235] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2cb1e28-3eff-48f9-865e-14c17e13b8cb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.309227] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.309423] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.309495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.309730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.309891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.322493] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 in Status: IN_PROGRESS for 2s [ 983.723515] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0602c86f-34c6-42e5-a101-35f6c95de05b: rpc.has_security_group_logging(os_id): False [ 983.743765] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.744409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.744409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.744409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.744409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.744594] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.744655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.744755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.745273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.745273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.745273] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.745273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.745273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.745584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.745584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.745667] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.745760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.745819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.745958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.746155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.746257] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 983.758152] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.791255] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.791577] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.791762] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.792145] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.792349] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.792536] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port e2cb1e28-3eff-48f9-865e-14c17e13b8cb not found, creating... [ 983.792904] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.793423] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.793614] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.793934] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.794323] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.794742] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.794886] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.795061] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.795428] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.795638] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.795823] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: e2cb1e28-3eff-48f9-865e-14c17e13b8cb is going to be created. [ 983.809908] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.810170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.810255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.810432] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.810569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.816351] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.816351] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.816351] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.816351] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.816351] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.816351] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-e2cb1e28-3eff-48f9-865e-14c17e13b8cb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.825204] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 984.260820] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.260820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.260820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.260820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.260820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.260820] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 984.289375] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.289999] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.292898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.292898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.292898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.300177] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 984.807470] env[69692]: INFO networking_nsxv3.common.synchronization [req-93a1a542-a236-48ae-b321-9ec7c4706c15 req-7b82a357-83c2-483c-a7ee-3fa4d7b30780 service nova] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_rules [ 984.809082] env[69692]: INFO networking_nsxv3.common.synchronization [req-93a1a542-a236-48ae-b321-9ec7c4706c15 req-7b82a357-83c2-483c-a7ee-3fa4d7b30780 service nova] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 984.809573] env[69692]: INFO networking_nsxv3.common.synchronization [req-93a1a542-a236-48ae-b321-9ec7c4706c15 req-7b82a357-83c2-483c-a7ee-3fa4d7b30780 service nova] Enqueued Resource ID: e2cb1e28-3eff-48f9-865e-14c17e13b8cb with Priority: HIGHEST for action port [ 984.810243] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_rules [ 984.814228] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 984.814228] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2cb1e28-3eff-48f9-865e-14c17e13b8cb with Priority: HIGHEST for action port [ 984.814559] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.815803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.816423] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.816641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.819035] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2cb1e28-3eff-48f9-865e-14c17e13b8cb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.819035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2cb1e28-3eff-48f9-865e-14c17e13b8cb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.819035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2cb1e28-3eff-48f9-865e-14c17e13b8cb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.819035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2cb1e28-3eff-48f9-865e-14c17e13b8cb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.819035] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2cb1e28-3eff-48f9-865e-14c17e13b8cb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.319827] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2cb1e28-3eff-48f9-865e-14c17e13b8cb with status ACTIVE [ 985.320934] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.320934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.320934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.320934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.320934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.321260] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.321260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.321260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.321436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.321521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.321732] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.321839] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.321902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.322106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.322198] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.322284] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2cb1e28-3eff-48f9-865e-14c17e13b8cb is going to be updated. [ 985.337836] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 in Status: SUCCESS [ 985.338061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.349928] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.350322] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.351318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.351318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.351318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.351318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2cb1e28-3eff-48f9-865e-14c17e13b8cb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.839271] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 985.842602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.309913] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 986.310183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.310555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.310672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.310867] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.311235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.311235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.311328] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.311328] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.311642] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.814607] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.317142] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.821675] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.822119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.822119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.822244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.822244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.822338] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 987.853123] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.853123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.853123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.853428] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.853428] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.861581] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 988.726013] env[69692]: INFO networking_nsxv3.common.synchronization [req-61bcfe49-9e7d-4367-bac0-2bf5d81fb15c req-5c0a4514-d888-4d09-bbe0-d3f229836bb6 tempest-ServersAdminTestJSON-1982348900 tempest-ServersAdminTestJSON-1982348900-project-member] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 988.726548] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 988.726859] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.726978] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.727052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.727259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.727410] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.727508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.727570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.727714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.727797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.727887] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.807147] env[69692]: INFO networking_nsxv3.common.synchronization [None req-84366d2c-595d-4491-a06d-5cadde89586a tempest-ServerActionsTestJSON-532161054 tempest-ServerActionsTestJSON-532161054-project-member] Enqueued Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGHEST for action security_group_rules [ 988.807147] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGHEST for action security_group_rules [ 988.807147] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-994aca44-3363-4f2f-9033-f0c0f6791222 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.807356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.807356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.807646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.808233] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.899233] env[69692]: INFO networking_nsxv3.common.synchronization [None req-939896f9-43e5-45f5-9312-f851fbcda6da tempest-ServerActionsTestJSON-532161054 tempest-ServerActionsTestJSON-532161054-project-member] Enqueued Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGHEST for action security_group_rules [ 988.899719] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGHEST for action security_group_rules [ 988.900020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-994aca44-3363-4f2f-9033-f0c0f6791222 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.900147] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.234709] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.327085] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.327342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.327342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.327426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.328184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.328184] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 994aca44-3363-4f2f-9033-f0c0f6791222 already deleted. [ 989.328184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.328184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.328184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.328184] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.738454] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.846877] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.847045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.847124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.847374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.847470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.847569] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 994aca44-3363-4f2f-9033-f0c0f6791222 already deleted. [ 989.847654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.869262] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 989.869378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.869534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.869742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.869946] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.870070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.870140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.870295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.870367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.870452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.870547] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.871372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.871539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.871693] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.872308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.872308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.872308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.873336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.873336] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.198266] env[69692]: INFO networking_nsxv3.common.synchronization [req-d9a5f851-724a-4465-9797-e860a0a245c6 req-a043f639-c3d4-4fb8-83b5-8b350cf0b9c9 tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 990.198792] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 990.199103] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.199225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.199293] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.199491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.199638] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.199778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.199778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.199927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.200577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.201895] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.241276] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.241443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.241519] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.241772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.241895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.241996] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 990.267523] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.267683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.267760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.267962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.268117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.276133] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 990.374367] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.374544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.377863] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.703521] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.887885] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.925618] env[69692]: INFO networking_nsxv3.common.synchronization [None req-e2c6b44a-34c3-4584-bb43-a31ddb6fac5e tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 990.926137] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 990.926574] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.926574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.207976] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.392894] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.392894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.392894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.392894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.392894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.392894] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 991.435399] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.435968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.436294] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.436686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.437179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.446267] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 991.520517] env[69692]: INFO networking_nsxv3.common.synchronization [None req-7e76eaff-9276-4cde-8d7f-25efb7a1f3ae None None] Enqueued Resource ID: 774ef2fa-846d-477e-8706-77e24d6291ac with Priority: HIGHEST for action port [ 991.520517] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 774ef2fa-846d-477e-8706-77e24d6291ac with Priority: HIGHEST for action port [ 991.520517] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-774ef2fa-846d-477e-8706-77e24d6291ac taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.520517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-774ef2fa-846d-477e-8706-77e24d6291ac" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.520517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-774ef2fa-846d-477e-8706-77e24d6291ac" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.522444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-774ef2fa-846d-477e-8706-77e24d6291ac" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.522444] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('774ef2fa-846d-477e-8706-77e24d6291ac',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.632216] env[69692]: INFO networking_nsxv3.common.synchronization [req-65b253a7-1f65-4ca2-8ba9-48b095b1c8a3 req-762e9504-3b16-4227-abc4-50729747504e tempest-ImagesTestJSON-510458365 tempest-ImagesTestJSON-510458365-project-member] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 991.633046] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 991.633046] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.633514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.633640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.633901] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.635025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.635269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.635382] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.635604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.635737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.635873] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.710460] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.710763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.710894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.711184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.711397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.711567] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 991.738422] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.739291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.739291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.739421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.739702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.749026] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 992.024327] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 774ef2fa-846d-477e-8706-77e24d6291ac [ 992.024741] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.024741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.024846] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.025130] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.025488] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.025488] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:774ef2fa-846d-477e-8706-77e24d6291ac already deleted. [ 992.025488] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-774ef2fa-846d-477e-8706-77e24d6291ac" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.107620] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.107859] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.107969] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.108324] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.108492] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.108652] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.108762] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.108976] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.109242] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.109486] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 992.109633] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.109768] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.109899] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.110275] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 992.110652] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.110652] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.128594] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.128761] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 992.128909] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.129105] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.129426] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-10d53098-1f6b-4270-b8c1-524d1d25de86 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.129606] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-10d53098-1f6b-4270-b8c1-524d1d25de86" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.129732] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-10d53098-1f6b-4270-b8c1-524d1d25de86" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.130079] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-10d53098-1f6b-4270-b8c1-524d1d25de86" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.130261] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10d53098-1f6b-4270-b8c1-524d1d25de86',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.138145] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.138276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.138344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.138541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.138627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.138810] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.138900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.138958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.139159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.139235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.139319] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 992.179622] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.179748] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.183021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.183021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.183021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.190219] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 992.286949] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 992.287242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.636193] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.636391] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.636523] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.637272] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.637571] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.637755] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 10d53098-1f6b-4270-b8c1-524d1d25de86 not found, creating... [ 992.638047] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.638220] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.638341] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.638598] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.638746] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.639039] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.639827] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.639961] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.640470] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.640470] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.640602] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 10d53098-1f6b-4270-b8c1-524d1d25de86 is going to be created. [ 992.662395] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.662395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.662395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.662395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.662395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.662395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-10d53098-1f6b-4270-b8c1-524d1d25de86" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.359629] env[69692]: INFO networking_nsxv3.common.synchronization [req-65b253a7-1f65-4ca2-8ba9-48b095b1c8a3 req-f6b19415-1b42-44a1-9fc9-c472cf9f451e service nova] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_rules [ 993.359914] env[69692]: INFO networking_nsxv3.common.synchronization [req-65b253a7-1f65-4ca2-8ba9-48b095b1c8a3 req-f6b19415-1b42-44a1-9fc9-c472cf9f451e service nova] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 993.359964] env[69692]: INFO networking_nsxv3.common.synchronization [req-65b253a7-1f65-4ca2-8ba9-48b095b1c8a3 req-f6b19415-1b42-44a1-9fc9-c472cf9f451e service nova] Enqueued Resource ID: 10d53098-1f6b-4270-b8c1-524d1d25de86 with Priority: HIGHEST for action port [ 993.360494] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_rules [ 993.360631] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 993.360732] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d53098-1f6b-4270-b8c1-524d1d25de86 with Priority: HIGHEST for action port [ 993.361020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.361149] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.361212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.361470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.361523] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.364064] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.364064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.364064] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-10d53098-1f6b-4270-b8c1-524d1d25de86 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.364064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10d53098-1f6b-4270-b8c1-524d1d25de86" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.364064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10d53098-1f6b-4270-b8c1-524d1d25de86" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.364064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10d53098-1f6b-4270-b8c1-524d1d25de86" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.364064] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10d53098-1f6b-4270-b8c1-524d1d25de86',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.457376] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 993.459676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.459676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.459676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.459676] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.459676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.459676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.459676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.459676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.459676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.459676] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.459676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.459676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.459676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.459676] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.459676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.459676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.460933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.461205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.462210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.462210] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.761411] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 993.762479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.762479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.762479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.762479] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.762479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.762479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.762873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.762873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.762873] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.867107] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.867107] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.871018] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10d53098-1f6b-4270-b8c1-524d1d25de86 with status ACTIVE [ 993.871018] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.871018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.871018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.871018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.871018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.871018] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.871018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.871018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.871018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.871018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.871018] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.871018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.871018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.871018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.871018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.871018] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10d53098-1f6b-4270-b8c1-524d1d25de86 is going to be updated. [ 993.883463] env[69692]: INFO networking_nsxv3.common.synchronization [None req-99cd79ee-1aa0-4123-a02c-d5fca7effcd5 None None] Enqueued Resource ID: c2be1bb8-b638-48ee-a904-a498fa933be4 with Priority: HIGHEST for action port [ 993.884033] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2be1bb8-b638-48ee-a904-a498fa933be4 with Priority: HIGHEST for action port [ 993.884394] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2be1bb8-b638-48ee-a904-a498fa933be4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.884562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2be1bb8-b638-48ee-a904-a498fa933be4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.884668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2be1bb8-b638-48ee-a904-a498fa933be4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.884923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2be1bb8-b638-48ee-a904-a498fa933be4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.885065] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2be1bb8-b638-48ee-a904-a498fa933be4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.894321] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.894748] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.894833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.895111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.895251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.895573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10d53098-1f6b-4270-b8c1-524d1d25de86" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.963544] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c: rpc.has_security_group_logging(os_id): False [ 993.986316] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.986470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.986542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.986760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.986851] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.987600] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.987600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.987600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.987600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.987600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.987600] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.987843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.987843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.987913] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.987955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.988165] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.988250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.988306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.988441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.988511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.988591] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 994.038370] env[69692]: INFO networking_nsxv3.common.synchronization [req-cb5e621b-6e0e-4dc2-9dd8-4d83be10911f req-c81e20cd-0ed7-464d-b83e-c2fe2152ef8e tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGHEST for action security_group_members [ 994.038895] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGHEST for action security_group_members [ 994.039187] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-accdad5a-df21-4a41-8c89-449e7b8cd71b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.039481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.039481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.039575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.039698] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.039787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.039844] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.039979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.040154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.040271] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('accdad5a-df21-4a41-8c89-449e7b8cd71b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.200545] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.200753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.200849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.201150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.201337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.223718] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 994.223889] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e deletion is rescheduled due to dependency. [ 994.224012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.224166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.224392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.224574] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.224687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.224750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.224900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.224980] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.225087] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.241690] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 994.265091] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.265242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.265309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.265537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.265622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.265818] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.265911] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.265972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.266141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.266218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.266303] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 994.300736] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.300881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.300951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.301167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.301347] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.313688] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 994.387307] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2be1bb8-b638-48ee-a904-a498fa933be4 [ 994.387589] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.387731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.387731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.387920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.388011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.388134] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2be1bb8-b638-48ee-a904-a498fa933be4 already deleted. [ 994.388405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2be1bb8-b638-48ee-a904-a498fa933be4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.543315] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.546773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.546773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.546773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.546773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.546773] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.546773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.546773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.546773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.546773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.546773] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: accdad5a-df21-4a41-8c89-449e7b8cd71b is going to be updated. [ 994.586108] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.586108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.586108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.586108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.586108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.596544] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: accdad5a-df21-4a41-8c89-449e7b8cd71b in Status: IN_PROGRESS for 2s [ 994.727167] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.915147] env[69692]: INFO networking_nsxv3.common.synchronization [req-1f4a7324-7eb5-4a9f-b9aa-a035340bb2d8 req-73e3c8be-6cf3-440b-a98b-4478e7a67efa tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 994.915687] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 994.915986] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.916123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.916186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.916387] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.916540] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.916637] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.916698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.916840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.916921] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.917073] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.232222] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.371198] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.371198] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.371198] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.371198] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.371198] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.371684] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.371937] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.372324] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.374801] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.374801] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.374801] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 995.374801] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 995.374801] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 995.374801] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.374801] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 995.374801] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.400026] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.400026] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 995.400026] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.400026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.400026] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-cc0c9592-c7c8-4442-9a8c-52de60ca4cc6 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.400026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-cc0c9592-c7c8-4442-9a8c-52de60ca4cc6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.400026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-cc0c9592-c7c8-4442-9a8c-52de60ca4cc6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.400026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-cc0c9592-c7c8-4442-9a8c-52de60ca4cc6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.400026] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc0c9592-c7c8-4442-9a8c-52de60ca4cc6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.419879] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.736027] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.736027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.736027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.736027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.736027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.736027] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 995.766813] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.766942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.766982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.767213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.767360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.775638] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 995.903282] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.903538] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.903693] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.903978] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.904188] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.904354] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port cc0c9592-c7c8-4442-9a8c-52de60ca4cc6 not found, creating... [ 995.904664] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.904840] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.905063] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.905235] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.905393] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.905706] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.905875] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.905996] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.906292] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.906397] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.906566] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: cc0c9592-c7c8-4442-9a8c-52de60ca4cc6 is going to be created. [ 995.921287] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.926371] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.926674] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.926837] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.927202] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.927557] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.927852] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-cc0c9592-c7c8-4442-9a8c-52de60ca4cc6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.253810] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 996.254069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.254247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.254480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.254568] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.323051] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 996.323051] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b deletion is rescheduled due to dependency. [ 996.323051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.423225] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.423611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.423682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.423898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.423989] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.424124] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 996.476220] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.476367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.476435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.476639] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.476927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.485557] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 996.610741] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: accdad5a-df21-4a41-8c89-449e7b8cd71b in Status: SUCCESS [ 996.610919] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: accdad5a-df21-4a41-8c89-449e7b8cd71b deletion is rescheduled due to dependency. [ 996.611105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.651020] env[69692]: INFO networking_nsxv3.common.synchronization [req-cd4f60c2-4242-4061-a930-764770a0a270 req-7a1a33ed-3e1f-4e7c-bb10-574606784aac tempest-ServersTestMultiNic-1078791388 tempest-ServersTestMultiNic-1078791388-project-member] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 996.651020] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 996.651020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.651020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.651020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.654498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.654498] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.654498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.654498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.654498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.654498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.654498] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.756913] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.757205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.904214] env[69692]: INFO networking_nsxv3.common.synchronization [req-1f4a7324-7eb5-4a9f-b9aa-a035340bb2d8 req-48ea9df4-57fe-4a8b-9513-48656e5e6bcb service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 996.904428] env[69692]: INFO networking_nsxv3.common.synchronization [req-1f4a7324-7eb5-4a9f-b9aa-a035340bb2d8 req-48ea9df4-57fe-4a8b-9513-48656e5e6bcb service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 996.904564] env[69692]: INFO networking_nsxv3.common.synchronization [req-1f4a7324-7eb5-4a9f-b9aa-a035340bb2d8 req-48ea9df4-57fe-4a8b-9513-48656e5e6bcb service nova] Enqueued Resource ID: cc0c9592-c7c8-4442-9a8c-52de60ca4cc6 with Priority: HIGHEST for action port [ 996.904798] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 996.904924] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 996.905068] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0c9592-c7c8-4442-9a8c-52de60ca4cc6 with Priority: HIGHEST for action port [ 996.905550] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.905675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.905741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.905940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.906315] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.907393] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.907725] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.907725] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc0c9592-c7c8-4442-9a8c-52de60ca4cc6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.907843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc0c9592-c7c8-4442-9a8c-52de60ca4cc6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.907875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc0c9592-c7c8-4442-9a8c-52de60ca4cc6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.908168] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc0c9592-c7c8-4442-9a8c-52de60ca4cc6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.908250] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc0c9592-c7c8-4442-9a8c-52de60ca4cc6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.988807] env[69692]: INFO networking_nsxv3.common.synchronization [req-cd4f60c2-4242-4061-a930-764770a0a270 req-81b7c7d4-1918-4d99-8669-75e485996130 tempest-ServersTestMultiNic-1078791388 tempest-ServersTestMultiNic-1078791388-project-member] Enqueued Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 996.988807] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c with Priority: HIGHEST for action security_group_members [ 996.988807] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.988807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.155815] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.410768] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.410901] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.411112] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc0c9592-c7c8-4442-9a8c-52de60ca4cc6 with status ACTIVE [ 997.411280] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.411398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.411468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.411681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.411780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.411950] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.412053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.412146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.412309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.412385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.412566] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.412661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.413165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.413165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.413165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.413165] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc0c9592-c7c8-4442-9a8c-52de60ca4cc6 is going to be updated. [ 997.434866] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.434866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.435223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.435223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.435298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.435404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc0c9592-c7c8-4442-9a8c-52de60ca4cc6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.659372] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.784980] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 997.785288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.785463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.785677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.785859] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.785971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.786045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.786205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.786279] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.786360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.786950] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.163030] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.163227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.163300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.163521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.163613] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.163710] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 998.189367] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.189498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.189541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.189704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.189840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.197914] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 998.289574] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.289752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.289800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.290013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.290196] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.290297] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.290362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.290511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.290602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.290685] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.290828] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.290919] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.290979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.291138] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.291297] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.291398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.291459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.291598] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.291674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.291754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.291843] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.500551] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 998.500827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.500952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.501633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.501633] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.501633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.501633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.501843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.501843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.501913] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.794458] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 480fedb1-b714-4d98-8f62-8eca0ff3855e: rpc.has_security_group_logging(os_id): False [ 998.811149] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.811346] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.811435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.811707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.811805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.813016] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.813016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.813016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.813016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.813016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.813016] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.813016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.813366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.813366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.813366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.813507] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.813600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.813693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.814709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.814919] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.815128] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 998.870945] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.871617] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.871617] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.873517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.873692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.884853] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 999.004054] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.506152] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.009352] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.009352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.009352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.009352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.009352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.009352] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1000.035954] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.036186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.036186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.036325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.036468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.044676] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1000.214032] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 1000.214032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.214256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.214432] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.214678] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.214787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.214787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.214918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.214974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.215056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.215156] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.216023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.216200] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.216361] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.216487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.216574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.216729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.216797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.216891] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.718998] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.719600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.719600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.719820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.720050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.720279] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.720458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.720458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.720618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.720693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.720767] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 1000.721983] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.722333] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.746623] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.746858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.746858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.747073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.747226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.755449] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 1000.897387] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1000.897666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.153579] env[69692]: INFO networking_nsxv3.common.synchronization [None req-761070f9-2248-4472-a7ba-c98a478c00b4 tempest-ServerDiskConfigTestJSON-756528476 tempest-ServerDiskConfigTestJSON-756528476-project-member] Enqueued Resource ID: cddee2cb-adde-48ef-80ae-22c8dc92d8f1 with Priority: HIGHEST for action security_group_rules [ 1001.153579] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddee2cb-adde-48ef-80ae-22c8dc92d8f1 with Priority: HIGHEST for action security_group_rules [ 1001.153579] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cddee2cb-adde-48ef-80ae-22c8dc92d8f1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.154319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cddee2cb-adde-48ef-80ae-22c8dc92d8f1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.154360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cddee2cb-adde-48ef-80ae-22c8dc92d8f1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.154627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cddee2cb-adde-48ef-80ae-22c8dc92d8f1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.154743] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cddee2cb-adde-48ef-80ae-22c8dc92d8f1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.282773] env[69692]: INFO networking_nsxv3.common.synchronization [None req-9ec682e4-7235-46ec-a7d1-c0ab78e400fd tempest-ServerDiskConfigTestJSON-756528476 tempest-ServerDiskConfigTestJSON-756528476-project-member] Enqueued Resource ID: cddee2cb-adde-48ef-80ae-22c8dc92d8f1 with Priority: HIGHEST for action security_group_rules [ 1001.282773] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddee2cb-adde-48ef-80ae-22c8dc92d8f1 with Priority: HIGHEST for action security_group_rules [ 1001.282773] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cddee2cb-adde-48ef-80ae-22c8dc92d8f1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.282773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cddee2cb-adde-48ef-80ae-22c8dc92d8f1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.674534] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.674689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.674765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.674972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.675077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.675170] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cddee2cb-adde-48ef-80ae-22c8dc92d8f1 already deleted. [ 1001.675256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cddee2cb-adde-48ef-80ae-22c8dc92d8f1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.675402] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cddee2cb-adde-48ef-80ae-22c8dc92d8f1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.675556] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cddee2cb-adde-48ef-80ae-22c8dc92d8f1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.675639] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cddee2cb-adde-48ef-80ae-22c8dc92d8f1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.054065] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1002.054359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.054499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.054728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.055277] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.055277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.055277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.055277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.055515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.055515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.055582] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.194676] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.194676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.194676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.194676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.194910] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.194910] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cddee2cb-adde-48ef-80ae-22c8dc92d8f1 already deleted. [ 1002.194910] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cddee2cb-adde-48ef-80ae-22c8dc92d8f1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.557789] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.558034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.558157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.558485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.558750] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.558920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.558991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.559156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.559313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.559449] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.559608] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.559729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.559812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.560171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.560423] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.560581] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.560706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.561030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.561212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.561349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.561526] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.767109] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 1002.767349] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c deletion is rescheduled due to dependency. [ 1002.767432] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.767600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.767841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.768060] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.768204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.768321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.768538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.768621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.768713] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.768898] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.769046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.769094] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.769263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.769415] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.769517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.769577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.769724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.769799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.769889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.769980] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.063591] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eab15f99-d56d-4017-8640-5d7acb890c08: rpc.has_security_group_logging(os_id): False [ 1003.081308] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.081453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.081525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.081733] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.081823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.082039] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.082201] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.082273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.082426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.082525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.082738] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.082884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.082984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.083314] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.083422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.083660] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.083752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.083807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.083959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.084051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.084140] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1003.145950] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.146174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.146231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.146419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.146579] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.158569] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1003.272389] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c: rpc.has_security_group_logging(os_id): False [ 1003.302799] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.302799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.302799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.302799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.303257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.303257] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.303257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.303378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.303475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.303552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.303740] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.303833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.303895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.304040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.304119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.304336] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.304430] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.304483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.304621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.304696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.304782] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c is going to be updated. [ 1003.379257] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.379257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.379257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.379257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.379257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.391778] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: IN_PROGRESS for 2s [ 1004.650495] env[69692]: INFO networking_nsxv3.common.synchronization [req-ba637425-d0d8-42c9-be9b-d5c08eb5c8f0 req-210bf6b5-41e7-47f3-9d52-cfc795059d39 tempest-ServerDiskConfigTestJSON-756528476 tempest-ServerDiskConfigTestJSON-756528476-project-member] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1004.650495] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1004.650495] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.650799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.650799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.650866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.651285] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.651285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.651285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.651408] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.651408] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.651468] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.880496] env[69692]: INFO networking_nsxv3.common.synchronization [req-59681097-d6c4-4b13-b4ca-d1f1b7168913 req-fc477a4a-e064-4126-af65-18075a36faf0 tempest-AttachVolumeTestJSON-1369618715 tempest-AttachVolumeTestJSON-1369618715-project-member] Enqueued Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGHEST for action security_group_members [ 1004.881035] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGHEST for action security_group_members [ 1004.881334] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.881452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.881513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.881713] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.881863] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.881958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.882032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.883604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.883604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.883604] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.155053] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.155453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.155453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.155453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.155559] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.158469] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.158469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.158469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.158469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.158469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.158469] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 1005.173844] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1005.173844] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.186932] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.187124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.187217] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.189474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.189474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.195498] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 1005.388246] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.388246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.388246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.388246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.388246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.388246] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.388246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.388246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.388246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.388246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.388246] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 is going to be updated. [ 1005.407601] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c in Status: SUCCESS [ 1005.407601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.419338] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.419536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.420604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.420604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.420604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.428824] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 in Status: IN_PROGRESS for 2s [ 1005.518234] env[69692]: INFO networking_nsxv3.common.synchronization [req-0a9604fe-2522-4023-8787-01d3648b3ac8 req-73a37f50-2737-4b48-9527-dd890730fa70 tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_members [ 1005.519245] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_members [ 1005.519735] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.520123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.520123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.520533] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.521689] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.521913] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.522075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.522374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.522561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.522758] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.027502] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.027502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.027502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.027502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.027502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.027502] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.027502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.027502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.027502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.027502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.027502] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 already deleted. [ 1006.027502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.162619] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-630 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.162829] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.162958] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.163523] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.163631] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.163790] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.163910] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.164148] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.164295] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.164512] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.164628] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.164740] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.164888] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.164965] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.165085] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.165220] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.182333] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.182548] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1006.182719] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.182909] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.183269] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-41cbef44-2a35-4a7e-9913-4e0dd62e2a6f taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.183456] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-41cbef44-2a35-4a7e-9913-4e0dd62e2a6f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.183602] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-41cbef44-2a35-4a7e-9913-4e0dd62e2a6f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.183943] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-41cbef44-2a35-4a7e-9913-4e0dd62e2a6f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.184120] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41cbef44-2a35-4a7e-9913-4e0dd62e2a6f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.685174] env[69692]: INFO networking_nsxv3.common.synchronization [req-a3d2ffcd-4bf4-40b5-83b7-6ae92fbac02a req-81ea154e-33e7-4777-8af1-740d2b30956b tempest-ServersV294TestFqdnHostnames-879312321 tempest-ServersV294TestFqdnHostnames-879312321-project-member] Enqueued Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGHEST for action security_group_members [ 1006.685174] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGHEST for action security_group_members [ 1006.685174] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.685174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.685174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.685174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.686281] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.686732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.686870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.687114] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.687301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.687526] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e7c8a7-d992-42fb-849a-a4f4ddc2f188',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.689156] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.689730] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.691018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.691018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.691018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.691018] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 41cbef44-2a35-4a7e-9913-4e0dd62e2a6f not found, creating... [ 1006.691018] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.691018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.691638] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.692371] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.693013] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.693410] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.694729] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.694729] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.694729] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.694729] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.694729] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 41cbef44-2a35-4a7e-9913-4e0dd62e2a6f is going to be created. [ 1006.715975] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.715975] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.715975] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.715975] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.715975] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.715975] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-41cbef44-2a35-4a7e-9913-4e0dd62e2a6f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.861021] env[69692]: INFO networking_nsxv3.common.synchronization [req-2cd84500-0c3e-42b6-8da4-47b9932f0c8d req-e86267c2-35ab-4c89-81e5-5b21fc55cc6f tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1006.861021] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1006.861021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.861021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.861021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.861021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.861021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.861547] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.861737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.862035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.862299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.862532] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.190151] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.190461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.190461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.190842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.190842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.190961] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.191120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.191218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.191399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.191512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.191965] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 is going to be updated. [ 1007.207535] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 1007.207770] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 deletion is rescheduled due to dependency. [ 1007.207900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.221708] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.221817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.221885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.224827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.224827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.234391] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 in Status: IN_PROGRESS for 2s [ 1007.364460] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.453584] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 in Status: SUCCESS [ 1007.453756] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 deletion is rescheduled due to dependency. [ 1007.453891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.516244] env[69692]: INFO networking_nsxv3.common.synchronization [req-0a9604fe-2522-4023-8787-01d3648b3ac8 req-1424407b-eaf9-41fc-8dc0-6ed5c450acdf service nova] Enqueued Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_rules [ 1007.516439] env[69692]: INFO networking_nsxv3.common.synchronization [req-0a9604fe-2522-4023-8787-01d3648b3ac8 req-1424407b-eaf9-41fc-8dc0-6ed5c450acdf service nova] Enqueued Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_members [ 1007.516581] env[69692]: INFO networking_nsxv3.common.synchronization [req-0a9604fe-2522-4023-8787-01d3648b3ac8 req-1424407b-eaf9-41fc-8dc0-6ed5c450acdf service nova] Enqueued Resource ID: 41cbef44-2a35-4a7e-9913-4e0dd62e2a6f with Priority: HIGHEST for action port [ 1007.516815] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_rules [ 1007.516942] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_members [ 1007.517052] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41cbef44-2a35-4a7e-9913-4e0dd62e2a6f with Priority: HIGHEST for action port [ 1007.517625] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.517754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.517812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.518874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.519107] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.519925] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.520049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.520117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.520555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.520720] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.520823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.520881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.521046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.521132] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.521219] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.522299] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-41cbef44-2a35-4a7e-9913-4e0dd62e2a6f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.522410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41cbef44-2a35-4a7e-9913-4e0dd62e2a6f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.522542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41cbef44-2a35-4a7e-9913-4e0dd62e2a6f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.522816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41cbef44-2a35-4a7e-9913-4e0dd62e2a6f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.522975] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41cbef44-2a35-4a7e-9913-4e0dd62e2a6f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.867870] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.024804] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.025849] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.026014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.027565] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41cbef44-2a35-4a7e-9913-4e0dd62e2a6f with status ACTIVE [ 1008.027735] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.027892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.027946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.028206] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.028206] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.028382] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.032022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.032187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.032395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.032493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.032714] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.032812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.032871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.033190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.033190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.033278] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41cbef44-2a35-4a7e-9913-4e0dd62e2a6f is going to be updated. [ 1008.056131] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.056131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.056131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.056363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.057644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.057644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41cbef44-2a35-4a7e-9913-4e0dd62e2a6f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.370929] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.370929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.371351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.371351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.371351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.371351] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1008.397297] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.397508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.397608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.397895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.398112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.408497] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1008.527301] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.029603] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.029773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.029883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.030121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.030233] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.030341] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 is going to be created. [ 1009.056883] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.057029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.057102] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.057308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.057461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.076276] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: UNINITIALIZED for 2s [ 1009.242274] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 in Status: SUCCESS [ 1009.242339] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 deletion is rescheduled due to dependency. [ 1009.242411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.914617] env[69692]: INFO networking_nsxv3.common.synchronization [req-030b22d0-d25a-493d-9b2a-c0df504cb3de req-5d894aaf-4112-4147-b728-decb0dc5b3dd tempest-AttachVolumeShelveTestJSON-1120054663 tempest-AttachVolumeShelveTestJSON-1120054663-project-member] Enqueued Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_members [ 1009.915088] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 859b640d-3815-457c-8a5b-e9eee00dbcee with Priority: HIGHEST for action security_group_members [ 1009.915427] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-859b640d-3815-457c-8a5b-e9eee00dbcee taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.916306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.916306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.916306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.916306] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.916306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.916306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.916953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.916953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.916953] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('859b640d-3815-457c-8a5b-e9eee00dbcee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.419486] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.419486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.419486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.419486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.419486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.419486] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.419486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.419486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.419486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.419932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.419932] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 859b640d-3815-457c-8a5b-e9eee00dbcee is going to be updated. [ 1010.428083] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1010.430160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.443994] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.444344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.444561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.444958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.446759] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.454157] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 859b640d-3815-457c-8a5b-e9eee00dbcee in Status: IN_PROGRESS for 2s [ 1011.085496] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: SUCCESS [ 1011.085888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.085888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.086117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.086313] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.086430] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.086486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.086647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.086728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.086814] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.086913] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.592651] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.601212] env[69692]: INFO networking_nsxv3.common.synchronization [None req-f283f32d-5436-4977-860d-185aad028f33 None None] Enqueued Resource ID: 95ba4a99-bb87-48a4-aec2-9f8f697b46ef with Priority: HIGHEST for action port [ 1011.602013] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95ba4a99-bb87-48a4-aec2-9f8f697b46ef with Priority: HIGHEST for action port [ 1011.602882] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-95ba4a99-bb87-48a4-aec2-9f8f697b46ef taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.602882] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95ba4a99-bb87-48a4-aec2-9f8f697b46ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.602882] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95ba4a99-bb87-48a4-aec2-9f8f697b46ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.603145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95ba4a99-bb87-48a4-aec2-9f8f697b46ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.603145] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95ba4a99-bb87-48a4-aec2-9f8f697b46ef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.094871] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ecdef958-2ee2-4519-a11c-44b06e5f8bd6: rpc.has_security_group_logging(os_id): False [ 1012.106123] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95ba4a99-bb87-48a4-aec2-9f8f697b46ef [ 1012.107439] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.107439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.107439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.107439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.107439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.107439] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95ba4a99-bb87-48a4-aec2-9f8f697b46ef already deleted. [ 1012.107439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95ba4a99-bb87-48a4-aec2-9f8f697b46ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.113944] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.113944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.113944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.113944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.113944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.113944] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.113944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.113944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.113944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.113944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.113944] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 is going to be created. [ 1012.172907] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.172907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.172907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.172907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.172907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.180591] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: IN_PROGRESS for 2s [ 1012.468056] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 859b640d-3815-457c-8a5b-e9eee00dbcee in Status: SUCCESS [ 1012.468056] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 859b640d-3815-457c-8a5b-e9eee00dbcee deletion is rescheduled due to dependency. [ 1012.468056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-859b640d-3815-457c-8a5b-e9eee00dbcee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.914276] env[69692]: INFO networking_nsxv3.common.synchronization [req-5971a92c-dca9-45f0-a0b7-39ddbdb9ff30 req-0539dccf-fdc3-4ac3-859d-d15b8a7ef6fe tempest-ServerActionsTestJSON-532161054 tempest-ServerActionsTestJSON-532161054-project-member] Enqueued Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGHEST for action security_group_members [ 1012.914917] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGHEST for action security_group_members [ 1012.917670] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-994aca44-3363-4f2f-9033-f0c0f6791222 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.917670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.917670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.917670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.917670] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.917670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.917670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.917670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.917670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.917670] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.062927] env[69692]: INFO networking_nsxv3.common.synchronization [req-7d2ebd1c-e6d6-4a16-923c-72d222ce379a req-6acadb8d-112b-425f-a838-b015d59db00a tempest-ServerActionsTestOtherB-2042336296 tempest-ServerActionsTestOtherB-2042336296-project-member] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1013.063541] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1013.064520] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.064520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.064520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.064520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.064520] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.064520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.064520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.064937] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.064937] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.064937] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.146492] env[69692]: INFO networking_nsxv3.common.synchronization [req-97ed47c0-b0a5-4688-aa99-c88d42095034 req-e46a20e3-4ec5-4267-b8d1-da8aedaf0288 tempest-ServersAdminTestJSON-1982348900 tempest-ServersAdminTestJSON-1982348900-project-member] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 1013.146492] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGHEST for action security_group_members [ 1013.146959] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.146959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.146959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.147211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.148218] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.148218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.148218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.148218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.148218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.148218] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.422593] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.422593] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.422593] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.422795] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.422849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.423034] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.423138] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.423220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.423383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.423460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.423559] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 994aca44-3363-4f2f-9033-f0c0f6791222 already deleted. [ 1013.423658] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.567880] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.568064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.568136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.568367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.590256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.590537] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.590672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.590749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.591014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.591072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.591184] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be updated. [ 1013.641963] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.641963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.641963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.641963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.641963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.654027] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: IN_PROGRESS for 2s [ 1013.654027] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.654027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.654027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.654027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.654027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.654027] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.654027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.654027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.654027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.654027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.654027] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be updated. [ 1013.661149] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.661149] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.661149] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.661149] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.661149] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.661149] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.661702] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.661984] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.662162] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.662451] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.662574] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.662688] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.662801] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.662913] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.663035] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.663195] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.680123] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.680362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.680434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.680634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.680775] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.692281] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.692515] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1013.692675] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.692862] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.693309] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-a67842ec-53d1-4577-bc8f-03fbf51ce240 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.693423] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-a67842ec-53d1-4577-bc8f-03fbf51ce240" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.693491] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-a67842ec-53d1-4577-bc8f-03fbf51ce240" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.693794] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-a67842ec-53d1-4577-bc8f-03fbf51ce240" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.693927] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a67842ec-53d1-4577-bc8f-03fbf51ce240',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.696858] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: IN_PROGRESS for 2s [ 1014.202024] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: SUCCESS [ 1014.202024] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.202024] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.202024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.202024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.202024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.202024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.202024] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port a67842ec-53d1-4577-bc8f-03fbf51ce240 not found, creating... [ 1014.202024] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.202975] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.203173] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.203390] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.204018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.204018] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.204181] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.204181] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.204968] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.204968] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.204968] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: a67842ec-53d1-4577-bc8f-03fbf51ce240 is going to be created. [ 1014.227260] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.228031] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.228031] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.228031] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.228231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.228462] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-a67842ec-53d1-4577-bc8f-03fbf51ce240" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.383096] env[69692]: INFO networking_nsxv3.common.synchronization [None req-ce28687d-ba74-40e9-92af-b0d2f838141c None None] Enqueued Resource ID: 0d5638af-e42f-4ff2-b9f0-0fad725267d2 with Priority: HIGHEST for action port [ 1014.383193] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d5638af-e42f-4ff2-b9f0-0fad725267d2 with Priority: HIGHEST for action port [ 1014.383762] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d5638af-e42f-4ff2-b9f0-0fad725267d2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.383896] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d5638af-e42f-4ff2-b9f0-0fad725267d2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.383967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d5638af-e42f-4ff2-b9f0-0fad725267d2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.384258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d5638af-e42f-4ff2-b9f0-0fad725267d2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.384328] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d5638af-e42f-4ff2-b9f0-0fad725267d2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.886941] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d5638af-e42f-4ff2-b9f0-0fad725267d2 [ 1014.887401] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.888648] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.888711] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.889051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.889159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.889318] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d5638af-e42f-4ff2-b9f0-0fad725267d2 already deleted. [ 1014.889462] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d5638af-e42f-4ff2-b9f0-0fad725267d2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.072540] env[69692]: INFO networking_nsxv3.common.synchronization [req-5971a92c-dca9-45f0-a0b7-39ddbdb9ff30 req-5132d4aa-5c3e-498f-824d-f1d08129623e service nova] Enqueued Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGHEST for action security_group_rules [ 1015.072722] env[69692]: INFO networking_nsxv3.common.synchronization [req-5971a92c-dca9-45f0-a0b7-39ddbdb9ff30 req-5132d4aa-5c3e-498f-824d-f1d08129623e service nova] Enqueued Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGHEST for action security_group_members [ 1015.072886] env[69692]: INFO networking_nsxv3.common.synchronization [req-5971a92c-dca9-45f0-a0b7-39ddbdb9ff30 req-5132d4aa-5c3e-498f-824d-f1d08129623e service nova] Enqueued Resource ID: a67842ec-53d1-4577-bc8f-03fbf51ce240 with Priority: HIGHEST for action port [ 1015.073528] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGHEST for action security_group_rules [ 1015.073666] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGHEST for action security_group_members [ 1015.073760] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a67842ec-53d1-4577-bc8f-03fbf51ce240 with Priority: HIGHEST for action port [ 1015.077680] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-994aca44-3363-4f2f-9033-f0c0f6791222 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.077862] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.077935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.078185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.078268] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.079233] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-994aca44-3363-4f2f-9033-f0c0f6791222 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.079374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.079473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.079679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.079875] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.079978] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.080069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.080226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.080330] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.080389] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.085168] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-a67842ec-53d1-4577-bc8f-03fbf51ce240 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.085281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a67842ec-53d1-4577-bc8f-03fbf51ce240" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.085281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a67842ec-53d1-4577-bc8f-03fbf51ce240" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.085468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a67842ec-53d1-4577-bc8f-03fbf51ce240" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.085548] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a67842ec-53d1-4577-bc8f-03fbf51ce240',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.410578] env[69692]: INFO networking_nsxv3.common.synchronization [req-0e94b440-f1bc-468e-800a-c2bfc736d380 req-7b123652-25f2-447d-8cb1-bdb9e43b9638 tempest-DeleteServersTestJSON-207338121 tempest-DeleteServersTestJSON-207338121-project-member] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1015.411122] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1015.411441] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.411574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.411632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.412653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.412653] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.413055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.413156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.413323] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.413444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.413496] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.588120] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.589424] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-994aca44-3363-4f2f-9033-f0c0f6791222 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.589424] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.589691] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a67842ec-53d1-4577-bc8f-03fbf51ce240 with status ACTIVE [ 1015.590663] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.590663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.590663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.590663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.590663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.590997] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.590997] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.590997] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.591801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.591801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.592328] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.596028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.596028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.596028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.596028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.596028] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a67842ec-53d1-4577-bc8f-03fbf51ce240 is going to be updated. [ 1015.613229] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.613481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.613590] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.613824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.613983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.614303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a67842ec-53d1-4577-bc8f-03fbf51ce240" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.667647] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: SUCCESS [ 1015.667878] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 deletion is rescheduled due to dependency. [ 1015.668046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.706267] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aade30ad-1e65-411f-be2a-2831f287cfbc in Status: SUCCESS [ 1015.706523] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc deletion is rescheduled due to dependency. [ 1015.706647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.902020] env[69692]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1015.902020] env[69692]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] NSXv3 Agent Agent loop - iteration:2 started [ 1015.915945] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.916292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.916292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.916513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.916606] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.916802] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.916900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.916964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.917133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.917210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.917624] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1015.943681] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.943829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.943907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.944153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.944696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.961947] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1016.095465] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.600579] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.600925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.600925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.601045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.601145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.601245] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 994aca44-3363-4f2f-9033-f0c0f6791222 is going to be created. [ 1016.624730] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.624730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.624730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.624730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.624730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.632894] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 994aca44-3363-4f2f-9033-f0c0f6791222 in Status: UNINITIALIZED for 2s [ 1017.508354] env[69692]: INFO networking_nsxv3.common.synchronization [req-fd188263-c4fc-4a28-bceb-32400a24f710 req-6f7ff0b3-023a-4c49-97b6-7e788097f093 tempest-ImagesOneServerNegativeTestJSON-1823576721 tempest-ImagesOneServerNegativeTestJSON-1823576721-project-member] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1017.509478] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1017.509677] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.509833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.509942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.510370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.510617] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.510678] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.510748] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.510861] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.510942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.511061] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.971907] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1017.972187] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 deletion is rescheduled due to dependency. [ 1017.973547] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.014209] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.014209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.014209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.014209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.014209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.014569] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.014569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.014569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.014724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.014724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.014802] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 already deleted. [ 1018.014883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.244431] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.244699] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-815" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.245054] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-815" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.245450] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-815" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.245821] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.246009] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.246151] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.246400] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.246615] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.246789] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.246928] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.251029] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.251029] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.251029] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.251029] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.251029] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.266755] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.266930] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.267142] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.267966] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-815" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.269590] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-89a9e72a-3eb3-4434-9c86-4a2071cf9750 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.269849] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-89a9e72a-3eb3-4434-9c86-4a2071cf9750" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.270061] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-89a9e72a-3eb3-4434-9c86-4a2071cf9750" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.271550] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-89a9e72a-3eb3-4434-9c86-4a2071cf9750" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.271550] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89a9e72a-3eb3-4434-9c86-4a2071cf9750',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.643727] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 994aca44-3363-4f2f-9033-f0c0f6791222 in Status: SUCCESS [ 1018.644070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.644070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.644198] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.644418] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.644657] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.644657] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.645224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.645224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.645224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.645224] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.774739] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.774739] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.774739] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.774739] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.774739] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.774739] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 89a9e72a-3eb3-4434-9c86-4a2071cf9750 not found, creating... [ 1018.774739] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.774739] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.774739] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.775175] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.775175] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.775325] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.775476] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.775594] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.775805] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.775950] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.776250] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 89a9e72a-3eb3-4434-9c86-4a2071cf9750 is going to be created. [ 1018.796323] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.796574] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.796704] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.797167] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.797445] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.798323] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-89a9e72a-3eb3-4434-9c86-4a2071cf9750" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.148880] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.499848] env[69692]: INFO networking_nsxv3.common.synchronization [req-fd188263-c4fc-4a28-bceb-32400a24f710 req-cc559596-af6a-4631-a977-93c5c2de9e13 service nova] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_rules [ 1019.502172] env[69692]: INFO networking_nsxv3.common.synchronization [req-fd188263-c4fc-4a28-bceb-32400a24f710 req-cc559596-af6a-4631-a977-93c5c2de9e13 service nova] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1019.502172] env[69692]: INFO networking_nsxv3.common.synchronization [req-fd188263-c4fc-4a28-bceb-32400a24f710 req-cc559596-af6a-4631-a977-93c5c2de9e13 service nova] Enqueued Resource ID: 89a9e72a-3eb3-4434-9c86-4a2071cf9750 with Priority: HIGHEST for action port [ 1019.502172] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_rules [ 1019.502172] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1019.502172] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a9e72a-3eb3-4434-9c86-4a2071cf9750 with Priority: HIGHEST for action port [ 1019.503151] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.503294] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.503362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.503612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.503691] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.504636] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.504757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.504821] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.504994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.505156] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.505247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.505305] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.505441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.505521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.505611] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.506369] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-89a9e72a-3eb3-4434-9c86-4a2071cf9750 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.506475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89a9e72a-3eb3-4434-9c86-4a2071cf9750" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.506529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89a9e72a-3eb3-4434-9c86-4a2071cf9750" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.506674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89a9e72a-3eb3-4434-9c86-4a2071cf9750" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.506741] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89a9e72a-3eb3-4434-9c86-4a2071cf9750',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.653562] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 994aca44-3363-4f2f-9033-f0c0f6791222: rpc.has_security_group_logging(os_id): False [ 1019.671425] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.671662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.671662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.671897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.671992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.672277] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.672395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.672461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.672625] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.672714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.672779] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 994aca44-3363-4f2f-9033-f0c0f6791222 is going to be created. [ 1019.733571] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.733730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.733799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.734035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.734219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.747785] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 994aca44-3363-4f2f-9033-f0c0f6791222 in Status: IN_PROGRESS for 2s [ 1020.008796] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.008928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.009150] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.009999] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89a9e72a-3eb3-4434-9c86-4a2071cf9750 with status ACTIVE [ 1020.010213] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.010324] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.010428] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.011356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.011356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.011356] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.011356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.011356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.011356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.011356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.011356] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.011772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.011772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.011772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.011772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.011772] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89a9e72a-3eb3-4434-9c86-4a2071cf9750 is going to be updated. [ 1020.033085] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.033263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.033403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.033628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.033738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.034255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89a9e72a-3eb3-4434-9c86-4a2071cf9750" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.250252] env[69692]: INFO networking_nsxv3.common.synchronization [None req-083984bd-3d74-40fe-9328-3afe27149207 tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_rules [ 1020.252311] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_rules [ 1020.252311] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.252311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.252311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.252311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.252311] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.383068] env[69692]: INFO networking_nsxv3.common.synchronization [None req-26d192b1-a250-4006-93d2-e1379826a65b tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_rules [ 1020.383705] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_rules [ 1020.383967] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.384081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.515563] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.771863] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.772074] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.772074] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.772383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.772491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.772634] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 already deleted. [ 1020.772699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.772811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.773009] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.773102] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.018663] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.018825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.018889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.019131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.019222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.019322] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 is going to be created. [ 1021.041242] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.041377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.041441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.041665] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.041811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.050981] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: UNINITIALIZED for 2s [ 1021.291985] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.292350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.292350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.292478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.292598] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.292654] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 already deleted. [ 1021.292735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.758863] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 994aca44-3363-4f2f-9033-f0c0f6791222 in Status: SUCCESS [ 1021.759132] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.078248] env[69692]: INFO networking_nsxv3.common.synchronization [req-89621f84-3e4f-4c3b-bd79-db41a5039278 req-3b64298a-57ba-4ba8-b95f-a814e1f428aa tempest-ImagesTestJSON-510458365 tempest-ImagesTestJSON-510458365-project-member] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1022.078785] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1022.079125] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.079459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.079459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.079570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.079723] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.079820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.079882] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.080144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.080144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.080239] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.584537] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.584868] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.584868] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.585277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.585420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.588121] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.588121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.588121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.588121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.588121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.588121] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 1022.611430] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.613691] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.613816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.614072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.614235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.622538] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 1023.062481] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: SUCCESS [ 1023.062721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.062907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.063188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.063406] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.063545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.063618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.063798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.063887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.063974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.064076] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.569847] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.570023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.570459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.570459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.570622] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.570795] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.570795] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.570860] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.570932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.571095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.571174] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.571327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.571327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.571471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.571585] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.571684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.571743] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.571877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.571951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.572045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.572131] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.681602] env[69692]: INFO networking_nsxv3.common.synchronization [req-7504651e-35f4-42a8-8b80-ea47e053ef9d req-de2eefa6-3d12-40ed-bff0-22966b26678d tempest-ServerDiskConfigTestJSON-756528476 tempest-ServerDiskConfigTestJSON-756528476-project-member] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1023.683445] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1023.683820] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.684013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.684879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.685263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.685346] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.685445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.685512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.685676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.685762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.685855] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.075448] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06b41f20-e9f6-4dd0-84af-8ce8a036eff7: rpc.has_security_group_logging(os_id): False [ 1024.094222] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.094417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.094523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.094776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.094869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.095094] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.095194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.095248] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.095403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.095567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.095684] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.095758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.095814] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.095952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.097128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.097345] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.097449] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.097528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.097727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.097727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.097888] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 is going to be created. [ 1024.162250] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.162492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.162609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.162784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.162974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.173169] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: IN_PROGRESS for 2s [ 1024.192887] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.192887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.192887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.192887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.192887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.192887] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.192887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.192887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.192887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.192887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.192887] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 1024.220431] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.220634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.220708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.220943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.221109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.241546] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 1024.321022] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.321193] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.321318] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.322026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.322026] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.322408] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.322546] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.322789] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.323010] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.323254] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.323400] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.323516] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.323632] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.323749] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.323865] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.323992] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.343684] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.344509] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1024.344509] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.344509] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.344723] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-84d7efcb-0afb-4f51-8a13-e9761ed1aa6e taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.344723] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-84d7efcb-0afb-4f51-8a13-e9761ed1aa6e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.344918] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-84d7efcb-0afb-4f51-8a13-e9761ed1aa6e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.345220] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-84d7efcb-0afb-4f51-8a13-e9761ed1aa6e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.345371] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84d7efcb-0afb-4f51-8a13-e9761ed1aa6e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.632145] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1024.632265] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e deletion is rescheduled due to dependency. [ 1024.632366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.848623] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.848954] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.848994] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.849281] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.849456] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.849591] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 84d7efcb-0afb-4f51-8a13-e9761ed1aa6e not found, creating... [ 1024.850253] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.850253] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.850253] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.850483] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.850483] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.850837] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.852334] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.852516] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.853553] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.853553] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.853553] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 84d7efcb-0afb-4f51-8a13-e9761ed1aa6e is going to be created. [ 1024.884895] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.884895] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.884895] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.884895] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.885161] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.885805] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-84d7efcb-0afb-4f51-8a13-e9761ed1aa6e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.733170] env[69692]: INFO networking_nsxv3.common.synchronization [req-7504651e-35f4-42a8-8b80-ea47e053ef9d req-88c1effd-5d6e-4182-a6b2-4cb87efb6fff service nova] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_rules [ 1025.733170] env[69692]: INFO networking_nsxv3.common.synchronization [req-7504651e-35f4-42a8-8b80-ea47e053ef9d req-88c1effd-5d6e-4182-a6b2-4cb87efb6fff service nova] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1025.733170] env[69692]: INFO networking_nsxv3.common.synchronization [req-7504651e-35f4-42a8-8b80-ea47e053ef9d req-88c1effd-5d6e-4182-a6b2-4cb87efb6fff service nova] Enqueued Resource ID: 84d7efcb-0afb-4f51-8a13-e9761ed1aa6e with Priority: HIGHEST for action port [ 1025.733170] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_rules [ 1025.733170] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1025.733170] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84d7efcb-0afb-4f51-8a13-e9761ed1aa6e with Priority: HIGHEST for action port [ 1025.733170] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.733170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.733170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.733170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.733170] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.733877] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.734077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.734152] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-84d7efcb-0afb-4f51-8a13-e9761ed1aa6e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.734249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84d7efcb-0afb-4f51-8a13-e9761ed1aa6e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.734314] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84d7efcb-0afb-4f51-8a13-e9761ed1aa6e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.734469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84d7efcb-0afb-4f51-8a13-e9761ed1aa6e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.734541] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84d7efcb-0afb-4f51-8a13-e9761ed1aa6e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.758313] env[69692]: INFO networking_nsxv3.common.synchronization [None req-e79c5352-4fe2-4097-9976-ec9f957ac13a tempest-AttachVolumeTestJSON-1369618715 tempest-AttachVolumeTestJSON-1369618715-project-member] Enqueued Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGHEST for action security_group_rules [ 1025.758313] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGHEST for action security_group_rules [ 1025.758313] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddea2811-281c-4b6c-b3c2-13049eb000a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.758313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.758313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.758313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.758313] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddea2811-281c-4b6c-b3c2-13049eb000a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.836809] env[69692]: INFO networking_nsxv3.common.synchronization [None req-26ad1394-0490-4009-9403-7fe07b6b9155 tempest-AttachVolumeTestJSON-1369618715 tempest-AttachVolumeTestJSON-1369618715-project-member] Enqueued Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGHEST for action security_group_rules [ 1025.837163] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGHEST for action security_group_rules [ 1025.837762] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddea2811-281c-4b6c-b3c2-13049eb000a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.837762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.185216] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: SUCCESS [ 1026.186119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.234249] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.234391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.235709] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84d7efcb-0afb-4f51-8a13-e9761ed1aa6e with status ACTIVE [ 1026.236075] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.236075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.236075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.236295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.236476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.236666] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.236766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.236819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.236991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.237078] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.237260] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.237354] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.237418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.237556] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.237631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.237736] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84d7efcb-0afb-4f51-8a13-e9761ed1aa6e is going to be updated. [ 1026.250769] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 1026.250769] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 deletion is rescheduled due to dependency. [ 1026.250769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.250925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.251115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.251291] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.251404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.251479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.251622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.251701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.251797] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.260503] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.260503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.260503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.260690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.260894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.260979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84d7efcb-0afb-4f51-8a13-e9761ed1aa6e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.276973] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.276973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.276973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.277187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.277187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.277338] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 already deleted. [ 1026.277402] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.277766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.278037] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.278037] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddea2811-281c-4b6c-b3c2-13049eb000a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.755946] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.799886] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.799886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.799886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.800107] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.800155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.800326] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 already deleted. [ 1026.800416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.203565] env[69692]: INFO networking_nsxv3.common.synchronization [req-734ab0f1-2207-40e2-9760-f5c5cd4010cf req-a594a828-6fbb-4bf0-a92e-d6ded22f41bf tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGHEST for action security_group_members [ 1027.203565] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGHEST for action security_group_members [ 1027.203565] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.203951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.203951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.203951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.204925] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.204925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.204925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.204925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.204925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.204925] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d9a7ff-d6e8-45b7-a6eb-87684637dd08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.259264] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.707767] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.707986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.708086] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.708304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.708500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.709028] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.709028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.709028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.709028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.709564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.709564] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 is going to be updated. [ 1027.745415] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.745415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.745415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.745933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.745933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.756385] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 in Status: IN_PROGRESS for 2s [ 1027.762807] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.762942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.763043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.763267] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.763359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.763550] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 1027.790969] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.791111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.791158] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.791678] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.791678] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.804252] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 1029.769057] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 in Status: SUCCESS [ 1029.769318] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 deletion is rescheduled due to dependency. [ 1029.769922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.811829] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 1029.812081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.812550] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.812774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.813021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.813103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.813163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.813321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.813405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.813502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.813578] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.319023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.319023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.319023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.319023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.319023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.319023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.319023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.319023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.319023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.319023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.319023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.319023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.319023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.319023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.319023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.319023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.319823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.319823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.319823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.319823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.319823] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.821707] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcbeb6f9-c515-4ff5-9c1f-1b944526d767: rpc.has_security_group_logging(os_id): False [ 1030.841989] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.842221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.842221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.842496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.842604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.842811] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.842912] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.842974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.843150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.843228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.843425] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.843552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.843618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.843764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.843836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.844049] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.844141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.844211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.844360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.844437] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.844519] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 1030.902845] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.902970] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.903057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.903279] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.903436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.914140] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 1031.626905] env[69692]: INFO networking_nsxv3.common.synchronization [None req-b0e9a325-4024-4e7f-b2ea-f19a6b2843e8 tempest-AttachVolumeShelveTestJSON-1120054663 tempest-AttachVolumeShelveTestJSON-1120054663-project-member] Enqueued Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_rules [ 1031.627343] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_rules [ 1031.627999] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a948ef5d-7e31-413f-8d23-aa989234c539 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.628382] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.628573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.628782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.629053] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.709603] env[69692]: INFO networking_nsxv3.common.synchronization [None req-03ca7f12-9d30-4383-990f-5667932a9f10 tempest-AttachVolumeShelveTestJSON-1120054663 tempest-AttachVolumeShelveTestJSON-1120054663-project-member] Enqueued Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_rules [ 1031.709603] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_rules [ 1031.709603] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a948ef5d-7e31-413f-8d23-aa989234c539 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.709603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.150694] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.150694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.150694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.150694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.150694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.150694] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a948ef5d-7e31-413f-8d23-aa989234c539 already deleted. [ 1032.150694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.150694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.150694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.150694] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.669708] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.669859] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.669932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.670167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.670262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.670356] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a948ef5d-7e31-413f-8d23-aa989234c539 already deleted. [ 1032.670439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.927236] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 1032.927379] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.860316] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.860316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.860316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.860805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.860805] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.362954] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.702973] env[69692]: INFO networking_nsxv3.common.synchronization [req-04e93ae8-02b5-4542-8e98-1c24954801b8 req-b5fd19c5-0505-48a6-a32e-2cd590d07759 tempest-DeleteServersTestJSON-207338121 tempest-DeleteServersTestJSON-207338121-project-member] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1035.703511] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1035.703807] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.703937] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.704017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.705510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.706239] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.706239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.706239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.706239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.706239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.706239] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.866264] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.107734] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.108072] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.108072] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.108349] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.108621] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.108779] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.108909] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.109478] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.109919] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.109919] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.110035] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1036.110103] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1036.110210] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1036.110318] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.110444] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1036.110651] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1036.128727] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1036.128907] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1036.129191] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1036.129263] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.129540] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-d40350f2-c810-468e-a639-6f13c6b116ec taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.129713] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-d40350f2-c810-468e-a639-6f13c6b116ec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.129834] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-d40350f2-c810-468e-a639-6f13c6b116ec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.130182] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-d40350f2-c810-468e-a639-6f13c6b116ec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.130327] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d40350f2-c810-468e-a639-6f13c6b116ec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.209410] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.209540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.209620] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.209837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.209927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.210140] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.210238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.210325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.210605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.210742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.210861] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1036.234779] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.235159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.235235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.235462] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.235608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.243778] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1036.370817] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1036.370955] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1036.633390] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.633390] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.633390] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.633612] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.633781] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.633952] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port d40350f2-c810-468e-a639-6f13c6b116ec not found, creating... [ 1036.635511] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.635511] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.635511] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.635511] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.637253] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.638334] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.638334] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.638334] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.639674] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.639674] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.639674] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: d40350f2-c810-468e-a639-6f13c6b116ec is going to be created. [ 1036.661373] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.661639] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.661789] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.662181] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.662463] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.662840] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-d40350f2-c810-468e-a639-6f13c6b116ec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.144569] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.144895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.144895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.145024] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.158416] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1037.159354] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.160413] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1037.189345] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.189345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.189345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.189623] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.200514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.201657] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1037.201657] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1037.201657] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1037.253097] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.253252] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.253325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.253550] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.255141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.255346] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1037.330513] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.330513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.330513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.330513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.331583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.332155] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1037.393323] env[69692]: INFO networking_nsxv3.common.synchronization [req-04e93ae8-02b5-4542-8e98-1c24954801b8 req-774e067d-83b5-4700-8f42-4a8a613da7f4 service nova] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_rules [ 1037.393323] env[69692]: INFO networking_nsxv3.common.synchronization [req-04e93ae8-02b5-4542-8e98-1c24954801b8 req-774e067d-83b5-4700-8f42-4a8a613da7f4 service nova] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1037.393323] env[69692]: INFO networking_nsxv3.common.synchronization [req-04e93ae8-02b5-4542-8e98-1c24954801b8 req-774e067d-83b5-4700-8f42-4a8a613da7f4 service nova] Enqueued Resource ID: d40350f2-c810-468e-a639-6f13c6b116ec with Priority: HIGHEST for action port [ 1037.393323] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_rules [ 1037.393323] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1037.393946] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d40350f2-c810-468e-a639-6f13c6b116ec with Priority: HIGHEST for action port [ 1037.397588] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.400455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.400455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.400455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.400455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.400455] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1037.400455] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b8df4df4-eeff-413c-833f-3852b9a4a49a', 'accdad5a-df21-4a41-8c89-449e7b8cd71b', 'bcf8de7e-6145-413a-bbc2-af3db93cdf58', '0606438c-ea63-4fae-97b5-53d1cd997a59', '994aca44-3363-4f2f-9033-f0c0f6791222', '68e7c8a7-d992-42fb-849a-a4f4ddc2f188', '532815ef-03c8-40fb-91ab-292fc1c769b2', '3aeeb294-14c6-4fb6-bbb6-67a12deabbef', 'cf53673e-0676-4fd1-a46f-53f1c3572abd', 'aade30ad-1e65-411f-be2a-2831f287cfbc', '1d450c5a-e2df-45be-a358-d8fce8ee7d24', 'cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9', '92949372-ad62-4c3b-ab83-73cb755bd4de', 'c4a9da48-db34-4124-bc5a-acf3f884fbec', 'bcbeb6f9-c515-4ff5-9c1f-1b944526d767', 'b6ffdfa8-6380-47fd-b801-823581edd625', '06b41f20-e9f6-4dd0-84af-8ce8a036eff7', '501c3651-4f53-4420-b2dc-d80ff25930b1', '1eb8f10e-5f89-461b-a5a7-acb98b29cbbb', '40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1', 'c8b96c18-8a3b-48f3-8303-8b48b5735ba8', 'dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6', 'b1d9a7ff-d6e8-45b7-a6eb-87684637dd08', '803064c7-17f8-46ee-bdf3-20357514c794', 'b57d8773-fb88-48dd-8778-aad060b75558', 'f4dd1b93-af3a-481d-8833-92383b938f1f', 'b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2', '7ae9a71f-5c96-43e4-8524-e661508c021c', 'f5345cc2-0f25-4dd2-bed5-a938bfc6e247', 'eab15f99-d56d-4017-8640-5d7acb890c08', '9debc847-a741-46fa-9447-b1070c70a885', '8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c', '2c27a619-83e9-4ab1-a7c8-d2d45bd50134', '559d2715-9b43-4a1c-ab57-3faf644a7a85', 'cb8b39ac-23d5-452c-9ec6-33c3aa98d53f', '2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4', '859b640d-3815-457c-8a5b-e9eee00dbcee', '592d30d0-26f8-4498-ae9a-adafe7d95eb3', 'ecdef958-2ee2-4519-a11c-44b06e5f8bd6', 'a8524b03-3553-4474-98ff-53fee924a364', '0b6cb33c-9436-488b-bac4-02b8d09327a1', 'ebdff0ac-e383-4307-98b2-c7e34194e641', '543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a', 'c3f4ecb4-733b-4e4f-a088-b50706c8f083', '3c88a973-e953-4cb7-bda1-829fc68b91a4', 'ab04df45-cf74-4894-8e09-dc03e4e3ecab', '480fedb1-b714-4d98-8f62-8eca0ff3855e', '0602c86f-34c6-42e5-a101-35f6c95de05b'} {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1037.400455] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1037.400839] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.400839] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.400839] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.400958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.400994] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.402104] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.402202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.402429] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-d40350f2-c810-468e-a639-6f13c6b116ec taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.402557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d40350f2-c810-468e-a639-6f13c6b116ec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.402637] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d40350f2-c810-468e-a639-6f13c6b116ec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.402874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d40350f2-c810-468e-a639-6f13c6b116ec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.402993] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d40350f2-c810-468e-a639-6f13c6b116ec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.423267] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.423455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.423455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.423660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.423746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.423865] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1037.423938] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1037.424048] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1037.488014] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.488190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.488190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.488349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.489456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.489732] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1037.489856] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1037.489970] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1037.490016] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1037.490099] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/48 resources of Type:Security Group Rules [ 1037.490189] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGH for action security_group_rules [ 1037.490295] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGH for action security_group_rules [ 1037.490390] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGH for action security_group_rules [ 1037.490444] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGH for action security_group_rules [ 1037.490507] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGH for action security_group_rules [ 1037.490571] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGH for action security_group_rules [ 1037.490635] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGH for action security_group_rules [ 1037.490747] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGH for action security_group_rules [ 1037.490796] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf53673e-0676-4fd1-a46f-53f1c3572abd with Priority: HIGH for action security_group_rules [ 1037.490838] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGH for action security_group_rules [ 1037.490899] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGH for action security_group_rules [ 1037.490975] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGH for action security_group_rules [ 1037.491051] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGH for action security_group_rules [ 1037.491116] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGH for action security_group_rules [ 1037.491209] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGH for action security_group_rules [ 1037.491273] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6ffdfa8-6380-47fd-b801-823581edd625 with Priority: HIGH for action security_group_rules [ 1037.491340] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGH for action security_group_rules [ 1037.491416] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGH for action security_group_rules [ 1037.491479] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGH for action security_group_rules [ 1037.491552] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 with Priority: HIGH for action security_group_rules [ 1037.491917] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.905635] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d40350f2-c810-468e-a639-6f13c6b116ec with status ACTIVE [ 1037.905865] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.906039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.906098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.906286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.906376] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.907163] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.907163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.907163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.907163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.907163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.907163] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.908193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.908193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.908193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.908193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.908193] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d40350f2-c810-468e-a639-6f13c6b116ec is going to be updated. [ 1037.908710] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.908830] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.926845] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.927076] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.927076] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.927262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.927392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.927544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d40350f2-c810-468e-a639-6f13c6b116ec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.079338] env[69692]: INFO networking_nsxv3.common.synchronization [req-f32e96d9-4008-495b-ab50-08a489d5e9c1 req-95dc9a9c-de5b-4edc-a72f-ba65d07cc312 tempest-ImagesTestJSON-510458365 tempest-ImagesTestJSON-510458365-project-member] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1038.079880] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1038.080314] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8df4df4-eeff-413c-833f-3852b9a4a49a with Priority: HIGH for action security_group_rules [ 1038.080314] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 with Priority: HIGH for action security_group_rules [ 1038.080314] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGH for action security_group_rules [ 1038.080314] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGH for action security_group_rules [ 1038.080590] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 with Priority: HIGH for action security_group_rules [ 1038.080590] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb with Priority: HIGH for action security_group_rules [ 1038.080590] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 with Priority: HIGH for action security_group_rules [ 1038.080743] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGH for action security_group_rules [ 1038.080851] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGH for action security_group_rules [ 1038.081024] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6ffdfa8-6380-47fd-b801-823581edd625 with Priority: HIGH for action security_group_rules [ 1038.081695] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92949372-ad62-4c3b-ab83-73cb755bd4de with Priority: HIGH for action security_group_rules [ 1038.081855] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 with Priority: HIGH for action security_group_rules [ 1038.081976] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGH for action security_group_rules [ 1038.082063] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aade30ad-1e65-411f-be2a-2831f287cfbc with Priority: HIGH for action security_group_rules [ 1038.082159] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf53673e-0676-4fd1-a46f-53f1c3572abd with Priority: HIGH for action security_group_rules [ 1038.082699] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 with Priority: HIGH for action security_group_rules [ 1038.082828] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef with Priority: HIGH for action security_group_rules [ 1038.082979] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGH for action security_group_rules [ 1038.083100] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: accdad5a-df21-4a41-8c89-449e7b8cd71b with Priority: HIGH for action security_group_rules [ 1038.083196] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 with Priority: HIGH for action security_group_rules [ 1038.083494] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.083829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.083829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.083960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.084077] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.084177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.084239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.084390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.084658] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.084658] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.085365] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8df4df4-eeff-413c-833f-3852b9a4a49a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.085483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.085549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.085899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.085899] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8df4df4-eeff-413c-833f-3852b9a4a49a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.086579] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.086579] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.086789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.086789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.086789] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcf8de7e-6145-413a-bbc2-af3db93cdf58',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.087480] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.087571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.087754] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.087844] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.087903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.088073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.088294] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.094738] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.094890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.094968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.095175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.095261] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.095910] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.096027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.096101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.096244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.096313] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1eb8f10e-5f89-461b-a5a7-acb98b29cbbb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.096971] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-501c3651-4f53-4420-b2dc-d80ff25930b1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.097115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.097189] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.097296] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.097470] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('501c3651-4f53-4420-b2dc-d80ff25930b1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.098033] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.098139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.098205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.098348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.098417] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.099116] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4a9da48-db34-4124-bc5a-acf3f884fbec taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.099330] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.099402] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.099547] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.099613] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.100290] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6ffdfa8-6380-47fd-b801-823581edd625 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.100470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.100470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.100596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.100653] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6ffdfa8-6380-47fd-b801-823581edd625',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.101561] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92949372-ad62-4c3b-ab83-73cb755bd4de taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.101679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.101731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.101866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.101928] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92949372-ad62-4c3b-ab83-73cb755bd4de',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.102599] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.102709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.102928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.102928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.103145] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.103787] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.103897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.103963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.108216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.108307] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.108970] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aade30ad-1e65-411f-be2a-2831f287cfbc taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.109107] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.109178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.109324] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.109389] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aade30ad-1e65-411f-be2a-2831f287cfbc',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.110064] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf53673e-0676-4fd1-a46f-53f1c3572abd taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.110173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.110266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.110389] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.110463] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf53673e-0676-4fd1-a46f-53f1c3572abd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.111216] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.111422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.111422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.111607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.111685] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e7c8a7-d992-42fb-849a-a4f4ddc2f188',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.112367] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.112971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.112971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.112971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.112971] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3aeeb294-14c6-4fb6-bbb6-67a12deabbef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.113421] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-994aca44-3363-4f2f-9033-f0c0f6791222 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.113498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.113557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.113703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.113768] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.114746] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-accdad5a-df21-4a41-8c89-449e7b8cd71b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.114889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.114933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.115071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.115233] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('accdad5a-df21-4a41-8c89-449e7b8cd71b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.115935] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0606438c-ea63-4fae-97b5-53d1cd997a59 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.116058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.116119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.116283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.116379] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0606438c-ea63-4fae-97b5-53d1cd997a59',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.137066] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.137351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.137351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.137981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.140081] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.140189] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.155150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.155469] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1eb8f10e-5f89-461b-a5a7-acb98b29cbbb is going to be deleted. [ 1038.156834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.157093] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.172595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.172752] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8df4df4-eeff-413c-833f-3852b9a4a49a is going to be deleted. [ 1038.220163] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.220406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.220406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.220617] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.220714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.220870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1eb8f10e-5f89-461b-a5a7-acb98b29cbbb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.235499] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.235652] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.235717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.235900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.236058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.236170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8df4df4-eeff-413c-833f-3852b9a4a49a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.259662] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1038.259863] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 deletion is rescheduled due to dependency. [ 1038.259979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.260366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.260577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.260758] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.260891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.260953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.261121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.261203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.261297] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.415448] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.415657] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.415787] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.416080] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.416347] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.416497] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.416619] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.416854] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.417019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.419719] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.420575] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.420575] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.420575] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.420575] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.420575] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.420895] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.438112] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.438238] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1038.438382] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.438576] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.438875] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-eb7fc2d4-1068-46d8-839f-4bf5563c12c6 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.439070] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-eb7fc2d4-1068-46d8-839f-4bf5563c12c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.439188] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-eb7fc2d4-1068-46d8-839f-4bf5563c12c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.439503] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-eb7fc2d4-1068-46d8-839f-4bf5563c12c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.439644] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb7fc2d4-1068-46d8-839f-4bf5563c12c6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.619876] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.620104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.620184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.620455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.629860] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.629998] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.630081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.630279] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.630437] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.630582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.630640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.630807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.630934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.631277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.631722] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.632602] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a9da48-db34-4124-bc5a-acf3f884fbec taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.632685] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.632803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.632898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.633050] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.633393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.633469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.636549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.636549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.636549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.636549] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.638138] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-994aca44-3363-4f2f-9033-f0c0f6791222 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.638138] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.638138] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.638138] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.638138] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.638138] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.638138] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.638474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.639686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.639686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.639686] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.640651] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.640759] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.640822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.640973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.641124] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.641212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.641618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.642046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.642093] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.642203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.642273] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.693229] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.693349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.694440] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.694542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.695502] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.695595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.698138] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.698257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.698949] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.699060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.700275] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.700337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.700693] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.700807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.701841] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.701841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.702348] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.702441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.707897] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.707897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.707897] env[69692]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1038.707897] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.707897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.707897] env[69692]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1038.707897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.707897] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.707897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.707897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.707897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.708544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.708544] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 1038.709908] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.710060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.710060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.710239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.712132] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.712267] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.726024] env[69692]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1038.726634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.726795] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0606438c-ea63-4fae-97b5-53d1cd997a59 is going to be deleted. [ 1038.727963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.729312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.730761] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.730922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.730996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.731182] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.731451] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.738299] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 1038.747298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.747298] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: accdad5a-df21-4a41-8c89-449e7b8cd71b is going to be deleted. [ 1038.747298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.747298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.762915] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.765162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.765630] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6ffdfa8-6380-47fd-b801-823581edd625 is going to be deleted. [ 1038.766496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.766720] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.782510] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.782755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.788360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.788524] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3aeeb294-14c6-4fb6-bbb6-67a12deabbef is going to be deleted. [ 1038.789403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.789623] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.791113] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.791261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.806628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.806753] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1 is going to be deleted. [ 1038.807636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.807843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.825828] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.825962] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aade30ad-1e65-411f-be2a-2831f287cfbc is going to be deleted. [ 1038.826777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.827319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.842506] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.842675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.852341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.852460] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e7c8a7-d992-42fb-849a-a4f4ddc2f188 is going to be deleted. [ 1038.853332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.853526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.866912] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.867240] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.873533] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.873771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.884584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.884708] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf53673e-0676-4fd1-a46f-53f1c3572abd is going to be deleted. [ 1038.885526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.885730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.923872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.924023] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9 is going to be deleted. [ 1038.924883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.925154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.926420] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.926517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.936307] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.936490] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.942280] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.942486] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.942665] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.942947] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.943122] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.943279] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port eb7fc2d4-1068-46d8-839f-4bf5563c12c6 not found, creating... [ 1038.943537] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.943693] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.943815] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.944055] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.944199] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.944501] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.944667] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.944789] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.945008] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.945370] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.945490] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: eb7fc2d4-1068-46d8-839f-4bf5563c12c6 is going to be created. [ 1039.008221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.008393] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be deleted. [ 1039.009235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.009446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.019175] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.019373] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.019501] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.019760] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.019991] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.020235] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-eb7fc2d4-1068-46d8-839f-4bf5563c12c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.044152] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.044152] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92949372-ad62-4c3b-ab83-73cb755bd4de is going to be deleted. [ 1039.044152] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.044152] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.044502] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.044823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.099471] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.099471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.119025] env[69692]: INFO networking_nsxv3.common.synchronization [None req-757c6f15-cd0d-407c-847c-59e6f84e811f None None] Enqueued Resource ID: 695b058d-f6db-4ef9-bbf2-db24e0b81e10 with Priority: HIGHEST for action port [ 1039.119025] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 695b058d-f6db-4ef9-bbf2-db24e0b81e10 with Priority: HIGHEST for action port [ 1039.119025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-695b058d-f6db-4ef9-bbf2-db24e0b81e10 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.119025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-695b058d-f6db-4ef9-bbf2-db24e0b81e10" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.119025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-695b058d-f6db-4ef9-bbf2-db24e0b81e10" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.119025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-695b058d-f6db-4ef9-bbf2-db24e0b81e10" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.119025] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('695b058d-f6db-4ef9-bbf2-db24e0b81e10',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.121755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.122012] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 501c3651-4f53-4420-b2dc-d80ff25930b1 is going to be deleted. [ 1039.129195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.129195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.129195] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.129195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.156268] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.156611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.156611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.156761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.156939] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.157057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.157126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.157295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.157385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.157474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.157629] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.157726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.157788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.158336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.158499] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.158602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.158665] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.158812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.158893] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.158977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.159077] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.161329] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.161494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.161494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.161646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.161788] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.161902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.161971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.162078] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.162159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.162241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.162475] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.162561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.162689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.162823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.162960] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.163071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.163126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.163280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.163384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.163500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.163597] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.164701] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.165417] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.200846] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.200978] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcf8de7e-6145-413a-bbc2-af3db93cdf58 is going to be deleted. [ 1039.201982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.202229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.202374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.202518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0606438c-ea63-4fae-97b5-53d1cd997a59" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.202699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.202871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.202951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.203343] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-accdad5a-df21-4a41-8c89-449e7b8cd71b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.203843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.204114] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.204114] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.204215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6ffdfa8-6380-47fd-b801-823581edd625" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.204611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.204719] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.204799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.204963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3aeeb294-14c6-4fb6-bbb6-67a12deabbef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.205117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.205279] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.205358] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.205468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40dd4cbe-6b52-4d8f-ab13-cfe4a4adced1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.205597] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.205739] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.205813] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.205918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aade30ad-1e65-411f-be2a-2831f287cfbc" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.206052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.206194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.206269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.206377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e7c8a7-d992-42fb-849a-a4f4ddc2f188" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.206500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.206646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.206706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.206838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc7b48c4-0139-4811-99d4-3e6eaf6a8dc9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.206930] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.207345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.207449] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.207562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf53673e-0676-4fd1-a46f-53f1c3572abd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.207690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.207835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.208045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.208169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.265304] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.274699] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.274840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.274912] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.275373] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.275373] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.275517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92949372-ad62-4c3b-ab83-73cb755bd4de" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.301019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.301196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.301301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.301516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.301609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.301730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-501c3651-4f53-4420-b2dc-d80ff25930b1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.363675] env[69692]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1039.363675] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.363675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.363675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.363675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.363675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.363675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcf8de7e-6145-413a-bbc2-af3db93cdf58" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.623394] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 695b058d-f6db-4ef9-bbf2-db24e0b81e10 [ 1039.623394] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.623394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.623394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.623394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.623394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.623394] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:695b058d-f6db-4ef9-bbf2-db24e0b81e10 already deleted. [ 1039.623394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-695b058d-f6db-4ef9-bbf2-db24e0b81e10" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.663248] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06b41f20-e9f6-4dd0-84af-8ce8a036eff7: rpc.has_security_group_logging(os_id): False [ 1039.669123] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcbeb6f9-c515-4ff5-9c1f-1b944526d767: rpc.has_security_group_logging(os_id): False [ 1039.669123] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4a9da48-db34-4124-bc5a-acf3f884fbec: rpc.has_security_group_logging(os_id): False [ 1039.670035] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 994aca44-3363-4f2f-9033-f0c0f6791222: rpc.has_security_group_logging(os_id): False [ 1039.691411] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.691523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.691612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.691883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.694138] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.694256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.695150] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.695264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.696770] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.696770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.711212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.711212] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.711212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.711212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.711423] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.711473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.711562] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 994aca44-3363-4f2f-9033-f0c0f6791222 is going to be updated. [ 1039.712620] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.713972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.728487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.728810] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.728910] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.728975] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.729180] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.729260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.729352] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4a9da48-db34-4124-bc5a-acf3f884fbec is going to be updated. [ 1039.730340] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.730557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.754100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.754513] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.754513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.754659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.754743] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.754825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.755031] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.755130] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.755192] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.755348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.755424] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.755615] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.755695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.755754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.755892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.755990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.756886] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 1039.757936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.758128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.768261] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.768393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.768623] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.768699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.768746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.768813] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1039.771203] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.771325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.779826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.780069] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.780181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.780246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.780417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.780529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.780769] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.780873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.780974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.781100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.781175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.781388] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.781486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.781551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.781694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.781771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.781853] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 is going to be updated. [ 1039.782852] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.783029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.783170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.784819] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.784921] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.784988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.785147] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.785264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.804668] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 994aca44-3363-4f2f-9033-f0c0f6791222 in Status: IN_PROGRESS for 2s [ 1039.805499] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4a9da48-db34-4124-bc5a-acf3f884fbec in Status: IN_PROGRESS for 2s [ 1039.806902] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.807045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.807111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.807312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.807444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.813696] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1039.829648] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.829771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.829900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.830061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.830215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.862072] env[69692]: INFO networking_nsxv3.common.synchronization [req-f32e96d9-4008-495b-ab50-08a489d5e9c1 req-7157c6a9-3809-42a2-83de-2d21086cea0a service nova] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_rules [ 1039.862590] env[69692]: INFO networking_nsxv3.common.synchronization [req-f32e96d9-4008-495b-ab50-08a489d5e9c1 req-7157c6a9-3809-42a2-83de-2d21086cea0a service nova] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1039.862684] env[69692]: INFO networking_nsxv3.common.synchronization [req-f32e96d9-4008-495b-ab50-08a489d5e9c1 req-7157c6a9-3809-42a2-83de-2d21086cea0a service nova] Enqueued Resource ID: eb7fc2d4-1068-46d8-839f-4bf5563c12c6 with Priority: HIGHEST for action port [ 1039.863257] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_rules [ 1039.863322] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1039.863411] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb7fc2d4-1068-46d8-839f-4bf5563c12c6 with Priority: HIGHEST for action port [ 1039.863692] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.863886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.863886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.864090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.864171] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.864995] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.865100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.865293] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb7fc2d4-1068-46d8-839f-4bf5563c12c6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.865390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb7fc2d4-1068-46d8-839f-4bf5563c12c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.865454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb7fc2d4-1068-46d8-839f-4bf5563c12c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.865622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb7fc2d4-1068-46d8-839f-4bf5563c12c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.865702] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb7fc2d4-1068-46d8-839f-4bf5563c12c6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.883968] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.884129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.884211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.884394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.884533] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.887642] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 1039.921104] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: IN_PROGRESS for 2s [ 1040.367474] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb7fc2d4-1068-46d8-839f-4bf5563c12c6 with status ACTIVE [ 1040.367889] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.367889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.368034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.368203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.368242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.368406] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.368549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.368589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.368721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.368797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.368982] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.369109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.369272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.369272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.369502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.369502] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb7fc2d4-1068-46d8-839f-4bf5563c12c6 is going to be updated. [ 1040.370622] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.370709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.390343] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.391390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.391390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.391390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.391390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.391390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb7fc2d4-1068-46d8-839f-4bf5563c12c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.550460] env[69692]: INFO networking_nsxv3.common.synchronization [req-64d698a8-d938-432f-ab85-89fb5d730099 req-36c4fa61-b212-4539-b1df-8f20726cb00a tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_members [ 1040.551044] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_members [ 1040.552387] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef6eb63-26a4-4ff5-9105-ba8720b0e581 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.552520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.552817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.553539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.553740] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.553824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.554099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.554099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.554199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.554244] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.748287] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1040.748478] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e deletion is rescheduled due to dependency. [ 1040.748524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.748682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.748896] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.749094] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.749204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.749270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.749424] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.749515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.749609] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.019102] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.019102] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.019102] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.019102] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.019102] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.019102] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.019922] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.020416] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.020888] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.021894] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.021894] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.021894] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.021894] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.021894] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1041.024908] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.024908] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.040795] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.040960] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1041.041119] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.043217] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.043551] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-ddc00533-57b5-4d5c-820b-37a10037f2a2 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.043779] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-ddc00533-57b5-4d5c-820b-37a10037f2a2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.043913] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-ddc00533-57b5-4d5c-820b-37a10037f2a2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.044255] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-ddc00533-57b5-4d5c-820b-37a10037f2a2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.044400] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddc00533-57b5-4d5c-820b-37a10037f2a2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.058029] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.058029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.058029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.062012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.062012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.062012] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.062012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.062012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.062012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.062012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.062012] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 already deleted. [ 1041.062012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.252654] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.275652] env[69692]: INFO networking_nsxv3.common.synchronization [None req-4c8fefc8-8439-4e6f-a684-ee86cd0793d2 None None] Enqueued Resource ID: 823bb49c-98da-4afc-baf2-45452f407ca1 with Priority: HIGHEST for action port [ 1041.276736] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 823bb49c-98da-4afc-baf2-45452f407ca1 with Priority: HIGHEST for action port [ 1041.277093] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-823bb49c-98da-4afc-baf2-45452f407ca1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.277218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-823bb49c-98da-4afc-baf2-45452f407ca1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.277286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-823bb49c-98da-4afc-baf2-45452f407ca1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.277540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-823bb49c-98da-4afc-baf2-45452f407ca1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.277620] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('823bb49c-98da-4afc-baf2-45452f407ca1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.550746] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.551186] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.551186] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.551441] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.551570] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.551730] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port ddc00533-57b5-4d5c-820b-37a10037f2a2 not found, creating... [ 1041.552016] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.552188] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.552309] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.552759] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.552759] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.553020] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.553186] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.553299] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.553518] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.553672] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.553833] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: ddc00533-57b5-4d5c-820b-37a10037f2a2 is going to be created. [ 1041.575495] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.575766] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.575903] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.576214] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.576467] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.576721] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-ddc00533-57b5-4d5c-820b-37a10037f2a2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.755489] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.780107] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 823bb49c-98da-4afc-baf2-45452f407ca1 [ 1041.780107] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.780243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.780307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.780504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.780624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.780733] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:823bb49c-98da-4afc-baf2-45452f407ca1 already deleted. [ 1041.780815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-823bb49c-98da-4afc-baf2-45452f407ca1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.821271] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1041.821502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.821670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.822072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.822147] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.822209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.822309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.822507] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.822637] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.822794] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.822927] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.824361] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 994aca44-3363-4f2f-9033-f0c0f6791222 in Status: SUCCESS [ 1041.824549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.825528] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4a9da48-db34-4124-bc5a-acf3f884fbec in Status: SUCCESS [ 1041.825618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.899322] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 1041.900030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.933685] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: SUCCESS [ 1041.933965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.260975] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.261316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.261492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.261792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.261983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.262187] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 1042.289017] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.289017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.289017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.289017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.289257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.296818] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 1042.326398] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.326552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.326629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.326953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.327042] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.327312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.327382] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.327553] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.327641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.327838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.328570] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.328570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.328570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.328570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.328570] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.328570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.328570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.328570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.328908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.328908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.328908] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.396077] env[69692]: INFO networking_nsxv3.common.synchronization [req-64d698a8-d938-432f-ab85-89fb5d730099 req-3e88c95d-3e03-436d-9e46-ee27df3f7f69 service nova] Enqueued Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_rules [ 1042.396294] env[69692]: INFO networking_nsxv3.common.synchronization [req-64d698a8-d938-432f-ab85-89fb5d730099 req-3e88c95d-3e03-436d-9e46-ee27df3f7f69 service nova] Enqueued Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_members [ 1042.396440] env[69692]: INFO networking_nsxv3.common.synchronization [req-64d698a8-d938-432f-ab85-89fb5d730099 req-3e88c95d-3e03-436d-9e46-ee27df3f7f69 service nova] Enqueued Resource ID: ddc00533-57b5-4d5c-820b-37a10037f2a2 with Priority: HIGHEST for action port [ 1042.396671] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_rules [ 1042.396801] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_members [ 1042.396897] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddc00533-57b5-4d5c-820b-37a10037f2a2 with Priority: HIGHEST for action port [ 1042.397695] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.397695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.397695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.397979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.397979] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.398735] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef6eb63-26a4-4ff5-9105-ba8720b0e581 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.398897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.398947] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.399172] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.399246] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.399341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.399399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.399539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.399621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.399724] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.400655] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddc00533-57b5-4d5c-820b-37a10037f2a2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.400655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddc00533-57b5-4d5c-820b-37a10037f2a2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.400655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddc00533-57b5-4d5c-820b-37a10037f2a2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.400991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddc00533-57b5-4d5c-820b-37a10037f2a2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.400991] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddc00533-57b5-4d5c-820b-37a10037f2a2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.830901] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 532815ef-03c8-40fb-91ab-292fc1c769b2: rpc.has_security_group_logging(os_id): False [ 1042.854340] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.854495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.854568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.854789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.881487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.881780] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.881902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.881967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.882205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.882349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.883558] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.883558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.883558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.883558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.883558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.883558] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.883558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.883558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.884176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.884176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.884176] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1042.902888] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef6eb63-26a4-4ff5-9105-ba8720b0e581 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.903058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.903277] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.904209] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddc00533-57b5-4d5c-820b-37a10037f2a2 with status ACTIVE [ 1042.904398] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.904519] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.904584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.904783] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.904872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.905059] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.905169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.905228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.905356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.905426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.905608] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.905707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.905771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.905900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.905982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.908509] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddc00533-57b5-4d5c-820b-37a10037f2a2 is going to be updated. [ 1042.928433] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.928571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.928616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.928920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.929070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.929225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddc00533-57b5-4d5c-820b-37a10037f2a2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.954419] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.954614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.954691] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.955286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.955286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.968329] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1043.158384] env[69692]: INFO networking_nsxv3.common.synchronization [req-26426515-c060-4d4f-8252-ae0976f3c7c7 req-53d89fe8-ebf0-4469-b032-aaa91b013eeb tempest-ImagesOneServerNegativeTestJSON-1823576721 tempest-ImagesOneServerNegativeTestJSON-1823576721-project-member] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1043.158958] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1043.159276] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.159399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.159467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.159658] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.160024] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.160024] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.160179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.160179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.160279] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.160351] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.411572] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.662263] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.662427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.662495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.662786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.662873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.663090] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.663190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.663253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.663406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.663480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.663565] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 is going to be updated. [ 1043.701213] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.701361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.701361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.701596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.701758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.710173] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: IN_PROGRESS for 2s [ 1043.914538] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.914857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.914857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.914998] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.915104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.915203] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 is going to be created. [ 1043.941467] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.941690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.941761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.941946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.942208] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.951317] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: UNINITIALIZED for 2s [ 1044.305883] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1044.306126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.306291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.306510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.306729] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.306856] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.306969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.307109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.307191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.307280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.307369] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.811507] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.811672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.811889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.811964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.812139] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.812240] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.812306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.812465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.812551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.812640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.812855] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.812953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.813026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.813173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.813311] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.813403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.813463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.813599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.813792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.813792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.813906] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.936925] env[69692]: INFO networking_nsxv3.common.synchronization [req-577bf1f2-e3ef-49a8-a9b1-43eea2e257c8 req-eff6fcb0-d48b-4a01-b49f-d0b92a4afb22 tempest-AttachVolumeTestJSON-1369618715 tempest-AttachVolumeTestJSON-1369618715-project-member] Enqueued Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGHEST for action security_group_members [ 1044.937621] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGHEST for action security_group_members [ 1044.938021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddea2811-281c-4b6c-b3c2-13049eb000a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.938080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.938186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.938431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.938574] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.938629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.939417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.939417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.939417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.939417] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddea2811-281c-4b6c-b3c2-13049eb000a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.985206] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1044.985206] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.986187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.986187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.986187] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.318458] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 480fedb1-b714-4d98-8f62-8eca0ff3855e: rpc.has_security_group_logging(os_id): False [ 1045.338799] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.338799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.338799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.338799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.338799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.341942] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.341942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.341942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.341942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.341942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.341942] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.341942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.341942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.341942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.341942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.341942] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.341942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.341942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.341942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.342864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.342864] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 1045.400026] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.400184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.400248] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.400453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.400611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.414040] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 1045.442588] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.442792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.442894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.443083] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.443368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.443599] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.443755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.443755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.443913] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.443995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.444092] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 already deleted. [ 1045.444174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.449734] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.449916] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-496" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.450053] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-496" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.450298] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-496" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.450550] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.450704] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.450827] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.451060] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.451206] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.451414] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1045.451530] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1045.451692] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1045.451764] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1045.451856] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1045.451966] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1045.454008] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1045.473188] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1045.473349] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1045.473491] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1045.473663] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-496" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.473963] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-f53466d2-f6b6-4827-b645-13410447fe44 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.474155] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-f53466d2-f6b6-4827-b645-13410447fe44" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.474277] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-f53466d2-f6b6-4827-b645-13410447fe44" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.474580] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-f53466d2-f6b6-4827-b645-13410447fe44" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.474932] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f53466d2-f6b6-4827-b645-13410447fe44',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.488043] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.488210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.488277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.488465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.488631] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.488731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.488796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.488943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.489044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.489199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.489258] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.719214] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: SUCCESS [ 1045.719417] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 deletion is rescheduled due to dependency. [ 1045.719533] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.960694] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: SUCCESS [ 1045.960961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.961436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.961653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.961845] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.961960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.962143] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.962317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.962888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.962888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.962888] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.977133] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.979089] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.979089] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.979089] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.979089] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.979089] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port f53466d2-f6b6-4827-b645-13410447fe44 not found, creating... [ 1045.979089] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.979089] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.979089] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.979089] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.979089] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.979490] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.979490] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.979577] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.979782] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.980311] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.980311] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: f53466d2-f6b6-4827-b645-13410447fe44 is going to be created. [ 1045.991689] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.991689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.991689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.991689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.991996] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.991996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.991996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.992178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.992260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.992344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.992486] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.992582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.992640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.992798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.992933] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.993035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.993098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.993235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.993309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.993388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.993474] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.001039] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.001039] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.001039] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.001039] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.001039] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.001615] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-f53466d2-f6b6-4827-b645-13410447fe44" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.465030] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.499620] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 532815ef-03c8-40fb-91ab-292fc1c769b2: rpc.has_security_group_logging(os_id): False [ 1046.518073] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.518073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.518073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.518529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.518529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.518529] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.518652] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.518652] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.518876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.518991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.519200] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.520019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.520019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.520019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.520019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.520019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.520019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.520019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.520332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.520332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.520332] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1046.585896] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.588021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.588021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.588021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.588021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.610712] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1046.863821] env[69692]: INFO networking_nsxv3.common.synchronization [req-577bf1f2-e3ef-49a8-a9b1-43eea2e257c8 req-eb810cfe-b6c8-4819-bfd5-1a6dc5a754fa service nova] Enqueued Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGHEST for action security_group_rules [ 1046.864064] env[69692]: INFO networking_nsxv3.common.synchronization [req-577bf1f2-e3ef-49a8-a9b1-43eea2e257c8 req-eb810cfe-b6c8-4819-bfd5-1a6dc5a754fa service nova] Enqueued Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGHEST for action security_group_members [ 1046.864230] env[69692]: INFO networking_nsxv3.common.synchronization [req-577bf1f2-e3ef-49a8-a9b1-43eea2e257c8 req-eb810cfe-b6c8-4819-bfd5-1a6dc5a754fa service nova] Enqueued Resource ID: f53466d2-f6b6-4827-b645-13410447fe44 with Priority: HIGHEST for action port [ 1046.864468] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGHEST for action security_group_rules [ 1046.864623] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGHEST for action security_group_members [ 1046.864695] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f53466d2-f6b6-4827-b645-13410447fe44 with Priority: HIGHEST for action port [ 1046.865461] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddea2811-281c-4b6c-b3c2-13049eb000a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.865612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.865688] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.865972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.866080] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddea2811-281c-4b6c-b3c2-13049eb000a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.867112] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddea2811-281c-4b6c-b3c2-13049eb000a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.867228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.867290] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.869714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.869714] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.869714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.869714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.869714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.869714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.869714] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddea2811-281c-4b6c-b3c2-13049eb000a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.869714] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-f53466d2-f6b6-4827-b645-13410447fe44 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.869714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f53466d2-f6b6-4827-b645-13410447fe44" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.869714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f53466d2-f6b6-4827-b645-13410447fe44" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.869714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f53466d2-f6b6-4827-b645-13410447fe44" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.869714] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f53466d2-f6b6-4827-b645-13410447fe44',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.973387] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bef6eb63-26a4-4ff5-9105-ba8720b0e581: rpc.has_security_group_logging(os_id): False [ 1046.992706] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.992706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.992706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.992934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.992977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.993487] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.993487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.993487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.993753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.993791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.993900] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 is going to be created. [ 1047.057918] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.057918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.057918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.058234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.058338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.069291] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: IN_PROGRESS for 2s [ 1047.371771] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ddea2811-281c-4b6c-b3c2-13049eb000a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.373067] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddea2811-281c-4b6c-b3c2-13049eb000a4 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.373178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.373357] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f53466d2-f6b6-4827-b645-13410447fe44 with status ACTIVE [ 1047.373514] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.373619] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.373747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.373905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.375027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.375027] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.375027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.375027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.375027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.375027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.375027] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.375027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.375413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.375413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.375413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.375413] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f53466d2-f6b6-4827-b645-13410447fe44 is going to be updated. [ 1047.474389] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.474547] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.474621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.474837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.474979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.475154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f53466d2-f6b6-4827-b645-13410447fe44" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.475915] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1047.476114] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.877489] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ddea2811-281c-4b6c-b3c2-13049eb000a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.380905] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.381185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.381185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.381461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.381580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.381693] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 is going to be created. [ 1048.403576] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.403788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.403886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.404125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.404312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.412787] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 in Status: UNINITIALIZED for 2s [ 1048.624471] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1048.624704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.078362] env[69692]: INFO networking_nsxv3.common.synchronization [req-5f4cd5a1-2391-4162-9052-f586278530ef req-12847f4b-df79-48e5-9bc9-a1731280cbc2 tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1049.078622] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1049.078951] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.079120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.079227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.079390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.079553] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.079655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.079721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.079871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.079954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.080078] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.082556] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: SUCCESS [ 1049.082746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.467105] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.467439] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.467727] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.467877] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.468072] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.468199] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.468321] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.468575] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.468767] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.469019] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.469167] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.469326] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.469450] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.469569] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.469678] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.469813] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.488113] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.488341] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1049.488508] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.489255] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.489255] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-f3f51f15-6356-4800-b77b-42a6d2fbc6ba taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.489520] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-f3f51f15-6356-4800-b77b-42a6d2fbc6ba" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.489520] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-f3f51f15-6356-4800-b77b-42a6d2fbc6ba" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.489844] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-f3f51f15-6356-4800-b77b-42a6d2fbc6ba" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.490358] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3f51f15-6356-4800-b77b-42a6d2fbc6ba',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.583158] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.992813] env[69692]: INFO networking_nsxv3.common.synchronization [req-36a357ed-a77a-42ae-ad41-8a75b2fbb3ca req-adb07c5f-4160-4eb1-881b-ad211ca4b9af tempest-DeleteServersTestJSON-207338121 tempest-DeleteServersTestJSON-207338121-project-member] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1049.993442] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1049.993878] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.993976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.993976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.995068] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.995068] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.995216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.995216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.995384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.995472] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.995565] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.000018] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.000018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.000018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.000018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.000018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.000018] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port f3f51f15-6356-4800-b77b-42a6d2fbc6ba not found, creating... [ 1050.000018] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.000018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.000018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.000018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.000018] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.000515] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.000515] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.000515] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.000515] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.000515] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.001320] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: f3f51f15-6356-4800-b77b-42a6d2fbc6ba is going to be created. [ 1050.022237] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.023170] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.023170] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.023451] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.023683] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.024073] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-f3f51f15-6356-4800-b77b-42a6d2fbc6ba" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.084846] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.422299] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 in Status: SUCCESS [ 1050.422559] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.422815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.423104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.423267] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.423386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.423451] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.423609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.423692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.423796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.423896] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ddea2811-281c-4b6c-b3c2-13049eb000a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.503494] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.503865] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.503865] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.504032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.504134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.504333] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.504434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.504499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.504663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.504742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.504874] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1050.531899] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.532880] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.532880] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.532880] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.532880] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.541023] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1050.589400] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.589400] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.589400] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.589400] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.589400] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.589400] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1050.617990] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.617990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.617990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.617990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.617990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.626055] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1050.845481] env[69692]: INFO networking_nsxv3.common.synchronization [req-5f4cd5a1-2391-4162-9052-f586278530ef req-69e03724-3701-4628-b1ec-c3899bcea598 service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 1050.845481] env[69692]: INFO networking_nsxv3.common.synchronization [req-5f4cd5a1-2391-4162-9052-f586278530ef req-69e03724-3701-4628-b1ec-c3899bcea598 service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1050.845481] env[69692]: INFO networking_nsxv3.common.synchronization [req-5f4cd5a1-2391-4162-9052-f586278530ef req-69e03724-3701-4628-b1ec-c3899bcea598 service nova] Enqueued Resource ID: f3f51f15-6356-4800-b77b-42a6d2fbc6ba with Priority: HIGHEST for action port [ 1050.845481] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 1050.845481] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1050.845481] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3f51f15-6356-4800-b77b-42a6d2fbc6ba with Priority: HIGHEST for action port [ 1050.845481] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.845481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.845481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.846054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.846054] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.846767] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.846984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.847973] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3f51f15-6356-4800-b77b-42a6d2fbc6ba taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.848262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3f51f15-6356-4800-b77b-42a6d2fbc6ba" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.848334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3f51f15-6356-4800-b77b-42a6d2fbc6ba" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.848530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3f51f15-6356-4800-b77b-42a6d2fbc6ba" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.848612] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3f51f15-6356-4800-b77b-42a6d2fbc6ba',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.928626] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ddea2811-281c-4b6c-b3c2-13049eb000a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.350626] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.350626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.350936] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3f51f15-6356-4800-b77b-42a6d2fbc6ba with status ACTIVE [ 1051.350998] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.351121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.351191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.351798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.351798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.351798] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.351798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.351798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.352060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.352060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.352191] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.352283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.352395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.352545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.352605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.352657] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3f51f15-6356-4800-b77b-42a6d2fbc6ba is going to be updated. [ 1051.372185] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.372329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.372395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.372592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.372723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.372944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3f51f15-6356-4800-b77b-42a6d2fbc6ba" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.431855] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ddea2811-281c-4b6c-b3c2-13049eb000a4: rpc.has_security_group_logging(os_id): False [ 1051.455777] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.455777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.455777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.455777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.455777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.456056] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.456110] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.456145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.457419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.457419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.457419] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 is going to be created. [ 1051.477578] env[69692]: INFO networking_nsxv3.common.synchronization [req-0f2126be-fb84-47b8-b2d6-f4b98b7f865e req-6ef371cf-fe05-43d2-acc5-a410c5e3709f tempest-AttachVolumeShelveTestJSON-1120054663 tempest-AttachVolumeShelveTestJSON-1120054663-project-member] Enqueued Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_members [ 1051.478139] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_members [ 1051.478448] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a948ef5d-7e31-413f-8d23-aa989234c539 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.478603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.478675] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.478872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.483073] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.483241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.483306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.483506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.483585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.483683] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.537977] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.537977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.537977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.537977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.537977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.551941] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 in Status: IN_PROGRESS for 2s [ 1051.857754] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.858885] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.858885] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.858885] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.858885] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.858885] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.859284] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.859284] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.859371] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.859537] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.859655] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.859766] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.859879] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.859993] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.860114] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.860249] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.878434] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.879043] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1051.879043] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.879043] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.879644] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.879969] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.880200] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.880577] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.880809] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4caa43da-d5ab-4dea-80ae-8a77909ff4eb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.985407] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.985667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.985667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.985824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.985968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.986125] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.986222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.986283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.986435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.986530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.986578] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a948ef5d-7e31-413f-8d23-aa989234c539 already deleted. [ 1051.986702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.384084] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.384336] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.384450] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.384746] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.384989] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.385216] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 4caa43da-d5ab-4dea-80ae-8a77909ff4eb not found, creating... [ 1052.385529] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.385706] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.385824] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.386113] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.386313] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.386636] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.386792] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.386940] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.387174] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.387311] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.387473] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 4caa43da-d5ab-4dea-80ae-8a77909ff4eb is going to be created. [ 1052.406598] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.406824] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.406940] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.407287] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.407525] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.407775] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.557057] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1052.557057] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 deletion is rescheduled due to dependency. [ 1052.557057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.635844] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1052.635844] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.636030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.636344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.638527] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.638722] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.638819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.640825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.640957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.641094] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.145617] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.453757] env[69692]: INFO networking_nsxv3.common.synchronization [req-0f2126be-fb84-47b8-b2d6-f4b98b7f865e req-059e4e51-8390-49eb-b740-bb229386c4e6 service nova] Enqueued Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_rules [ 1053.453757] env[69692]: INFO networking_nsxv3.common.synchronization [req-0f2126be-fb84-47b8-b2d6-f4b98b7f865e req-059e4e51-8390-49eb-b740-bb229386c4e6 service nova] Enqueued Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_members [ 1053.453757] env[69692]: INFO networking_nsxv3.common.synchronization [req-0f2126be-fb84-47b8-b2d6-f4b98b7f865e req-059e4e51-8390-49eb-b740-bb229386c4e6 service nova] Enqueued Resource ID: 4caa43da-d5ab-4dea-80ae-8a77909ff4eb with Priority: HIGHEST for action port [ 1053.453757] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_rules [ 1053.453951] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_members [ 1053.453951] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4caa43da-d5ab-4dea-80ae-8a77909ff4eb with Priority: HIGHEST for action port [ 1053.454227] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a948ef5d-7e31-413f-8d23-aa989234c539 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.454352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.454437] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.454655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.454735] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.455578] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a948ef5d-7e31-413f-8d23-aa989234c539 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.455707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.455787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.455958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.456109] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.456248] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.456322] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.456578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.456822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.456822] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.457880] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.458014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.458074] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.458241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.458312] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4caa43da-d5ab-4dea-80ae-8a77909ff4eb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.575631] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 in Status: SUCCESS [ 1053.576087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.648311] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.948459] env[69692]: INFO networking_nsxv3.common.synchronization [req-6e5d8256-5fcd-43ce-8e82-985889097baa req-9dc9686f-1d1c-4532-8bf8-326a14f4320d tempest-ServerActionsTestOtherB-2042336296 tempest-ServerActionsTestOtherB-2042336296-project-member] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1053.949025] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1053.949346] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.949474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.949541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.949735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.949883] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.949982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.950059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.950236] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.950344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.950450] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.963709] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a948ef5d-7e31-413f-8d23-aa989234c539 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.963852] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.964097] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.965710] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4caa43da-d5ab-4dea-80ae-8a77909ff4eb with status ACTIVE [ 1053.965904] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.966100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.966282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.966487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.966610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.966824] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.967015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.971363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.971363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.971363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.971363] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.971363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.971363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.971363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.971363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.971873] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4caa43da-d5ab-4dea-80ae-8a77909ff4eb is going to be updated. [ 1053.996750] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.996750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.996750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.996750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.996750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.996750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.151126] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.151429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.151429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.151890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.151890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.152025] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1054.180056] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.181670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.182737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.182737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.182737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.193789] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1054.320022] env[69692]: INFO networking_nsxv3.common.synchronization [req-db76bead-e775-4996-9cae-edcb401c94f4 req-252cbf06-3283-461e-9ccd-a38625971328 tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGHEST for action security_group_members [ 1054.325808] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGHEST for action security_group_members [ 1054.325808] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4a9da48-db34-4124-bc5a-acf3f884fbec taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.325808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.325808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.325808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.325808] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.325808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.325808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.325808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.325808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.325808] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.336573] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-199 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.336573] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.336573] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.336844] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.337130] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.337294] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.337412] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.337640] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.337789] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.337996] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.338126] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.338235] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.338344] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.338455] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.338799] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.338799] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.340441] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.340546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.340614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.340771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.340857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.341034] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.341130] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.341191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.341331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.341405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.341487] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4a9da48-db34-4124-bc5a-acf3f884fbec is going to be updated. [ 1054.362132] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.362354] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1054.362524] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.362710] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.363142] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-743be538-81f8-4787-8097-149c80957c31 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.363374] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-743be538-81f8-4787-8097-149c80957c31" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.363481] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-743be538-81f8-4787-8097-149c80957c31" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.363870] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-743be538-81f8-4787-8097-149c80957c31" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.364041] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('743be538-81f8-4787-8097-149c80957c31',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.367597] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.367721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.367789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.367969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.368119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.376022] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a9da48-db34-4124-bc5a-acf3f884fbec in Status: IN_PROGRESS for 2s [ 1054.454958] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.455169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.455242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.455457] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.455609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.455821] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.455936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.456061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.456383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.456383] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.456625] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be deleted. [ 1054.474300] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.481521] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.481521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.481521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.481521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.481521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.481521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.868131] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.868131] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.868131] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.868131] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.868131] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.868131] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 743be538-81f8-4787-8097-149c80957c31 not found, creating... [ 1054.868131] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.870144] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.870144] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.870144] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.870144] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.870144] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.870144] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.870144] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.870144] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.870144] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.870144] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 743be538-81f8-4787-8097-149c80957c31 is going to be created. [ 1054.889395] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.889605] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.889864] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.890039] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.890312] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.890729] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-743be538-81f8-4787-8097-149c80957c31" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.980676] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.980676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.980676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.980676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.980676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.980676] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a948ef5d-7e31-413f-8d23-aa989234c539 is going to be created. [ 1055.007800] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.007975] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.008038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.008279] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.008407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.019188] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a948ef5d-7e31-413f-8d23-aa989234c539 in Status: UNINITIALIZED for 2s [ 1055.684897] env[69692]: INFO networking_nsxv3.common.synchronization [req-6e5d8256-5fcd-43ce-8e82-985889097baa req-d4d7988d-2078-49d6-bfd0-2c7a6d8acdaf service nova] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_rules [ 1055.685095] env[69692]: INFO networking_nsxv3.common.synchronization [req-6e5d8256-5fcd-43ce-8e82-985889097baa req-d4d7988d-2078-49d6-bfd0-2c7a6d8acdaf service nova] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1055.685256] env[69692]: INFO networking_nsxv3.common.synchronization [req-6e5d8256-5fcd-43ce-8e82-985889097baa req-d4d7988d-2078-49d6-bfd0-2c7a6d8acdaf service nova] Enqueued Resource ID: 743be538-81f8-4787-8097-149c80957c31 with Priority: HIGHEST for action port [ 1055.685492] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_rules [ 1055.685620] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1055.685716] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743be538-81f8-4787-8097-149c80957c31 with Priority: HIGHEST for action port [ 1055.686609] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.686746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.686836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.687144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.687237] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.689522] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.689522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.689522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.689522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.689522] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.689522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.689522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.689522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.689522] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.689522] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.690389] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-743be538-81f8-4787-8097-149c80957c31 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.690389] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-743be538-81f8-4787-8097-149c80957c31" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.690554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-743be538-81f8-4787-8097-149c80957c31" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.690554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-743be538-81f8-4787-8097-149c80957c31" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.690625] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('743be538-81f8-4787-8097-149c80957c31',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.194141] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.197332] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.197332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.197332] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 743be538-81f8-4787-8097-149c80957c31 with status ACTIVE [ 1056.197701] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.197916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.198088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.198358] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.198515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.198745] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.198933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.199067] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.199363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.199503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.199781] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.200591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.200918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.200918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.200965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.201039] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 743be538-81f8-4787-8097-149c80957c31 is going to be updated. [ 1056.210978] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1056.211277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.212508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.212508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.212508] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.212663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.212790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.213086] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.213304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.213353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.213618] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.224461] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.224615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.224763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.224873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.225481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.225481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-743be538-81f8-4787-8097-149c80957c31" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.385622] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4a9da48-db34-4124-bc5a-acf3f884fbec in Status: SUCCESS [ 1056.385816] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4a9da48-db34-4124-bc5a-acf3f884fbec deletion is rescheduled due to dependency. [ 1056.385952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.703115] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.716763] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.716763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.716763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.717651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.717651] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.717651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.717651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.717651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.717651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.717871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.717871] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.718067] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.718067] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.718376] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.718376] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.718526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.718570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.718698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.718776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.718880] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.718976] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.034615] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a948ef5d-7e31-413f-8d23-aa989234c539 in Status: SUCCESS [ 1057.034615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.034615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.034615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.034752] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.034825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.034856] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.035929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.035929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.035929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.035929] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.205822] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.206131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.206131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.206309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.206391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.206492] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be created. [ 1057.220807] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eab15f99-d56d-4017-8640-5d7acb890c08: rpc.has_security_group_logging(os_id): False [ 1057.230598] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.230751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.230825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.231077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.231228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.239031] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.239031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.239031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.239246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.240572] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: UNINITIALIZED for 2s [ 1057.257116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.257393] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.257513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.257580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.257781] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.257864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.258113] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.258220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.258285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.258436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.258513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.258703] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.258797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.258858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.258998] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.259086] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.259173] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1057.316657] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.316830] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.316903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.317137] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.317288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.327404] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1057.537588] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.041466] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a948ef5d-7e31-413f-8d23-aa989234c539: rpc.has_security_group_logging(os_id): False [ 1058.059665] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.059815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.059865] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.060093] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.060188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.060431] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.060529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.060592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.060739] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.060817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.061080] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a948ef5d-7e31-413f-8d23-aa989234c539 is going to be created. [ 1058.115275] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.115429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.115500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.115706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.115882] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.126031] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a948ef5d-7e31-413f-8d23-aa989234c539 in Status: IN_PROGRESS for 2s [ 1058.406931] env[69692]: INFO networking_nsxv3.common.synchronization [req-d6d8ee01-696e-41b9-acba-d7a8062f5119 req-127852f3-2670-481c-8074-abd664cc2956 tempest-ServerRescueNegativeTestJSON-8223595 tempest-ServerRescueNegativeTestJSON-8223595-project-member] Enqueued Resource ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 with Priority: HIGHEST for action security_group_members [ 1058.407455] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 with Priority: HIGHEST for action security_group_members [ 1058.407753] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.407879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.407955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.408168] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.408318] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.411035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.411035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.411310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.411441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.411581] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.915155] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.915155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.915155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.915155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.937968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.938286] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.938488] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.938488] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.938638] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.938767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.938845] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 is going to be updated. [ 1058.965473] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.965627] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.965706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.965948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.966119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.976834] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 in Status: IN_PROGRESS for 2s [ 1059.249975] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: SUCCESS [ 1059.250283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.250473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.250716] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.251633] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.251633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.251633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.251633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.251633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.251633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.251633] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.342787] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1059.343050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.753994] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.138093] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a948ef5d-7e31-413f-8d23-aa989234c539 in Status: SUCCESS [ 1060.138324] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.257283] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d450c5a-e2df-45be-a358-d8fce8ee7d24: rpc.has_security_group_logging(os_id): False [ 1060.274869] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.275063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.275063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.275820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.275820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.275820] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.275984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.275984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.276102] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.276192] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.276280] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be created. [ 1060.331598] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.331787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.331828] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.332049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.332235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.343076] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: IN_PROGRESS for 2s [ 1060.358560] env[69692]: INFO networking_nsxv3.common.synchronization [None req-f862ab2f-757f-4b21-9245-de68456f674e tempest-ImagesOneServerNegativeTestJSON-1823576721 tempest-ImagesOneServerNegativeTestJSON-1823576721-project-member] Enqueued Resource ID: a0e35541-8772-4615-9bd3-61b541d5f1b2 with Priority: HIGHEST for action security_group_rules [ 1060.359118] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e35541-8772-4615-9bd3-61b541d5f1b2 with Priority: HIGHEST for action security_group_rules [ 1060.359436] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0e35541-8772-4615-9bd3-61b541d5f1b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.359558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0e35541-8772-4615-9bd3-61b541d5f1b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.359618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0e35541-8772-4615-9bd3-61b541d5f1b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.359881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0e35541-8772-4615-9bd3-61b541d5f1b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.359964] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0e35541-8772-4615-9bd3-61b541d5f1b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.454521] env[69692]: INFO networking_nsxv3.common.synchronization [None req-e83cc346-ef2d-4d08-9c6a-b437b62b5b7e tempest-ImagesOneServerNegativeTestJSON-1823576721 tempest-ImagesOneServerNegativeTestJSON-1823576721-project-member] Enqueued Resource ID: a0e35541-8772-4615-9bd3-61b541d5f1b2 with Priority: HIGHEST for action security_group_rules [ 1060.455081] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e35541-8772-4615-9bd3-61b541d5f1b2 with Priority: HIGHEST for action security_group_rules [ 1060.455398] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0e35541-8772-4615-9bd3-61b541d5f1b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.455487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0e35541-8772-4615-9bd3-61b541d5f1b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.880365] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.880735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.880735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.880912] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.881054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.881220] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0e35541-8772-4615-9bd3-61b541d5f1b2 already deleted. [ 1060.881374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0e35541-8772-4615-9bd3-61b541d5f1b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.881621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0e35541-8772-4615-9bd3-61b541d5f1b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.882208] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0e35541-8772-4615-9bd3-61b541d5f1b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.882208] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0e35541-8772-4615-9bd3-61b541d5f1b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.986760] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 in Status: SUCCESS [ 1060.987016] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4 deletion is rescheduled due to dependency. [ 1060.987189] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.403338] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.403587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.403680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.403992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.404142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.404279] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0e35541-8772-4615-9bd3-61b541d5f1b2 already deleted. [ 1061.404402] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0e35541-8772-4615-9bd3-61b541d5f1b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.354777] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: SUCCESS [ 1062.354946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.238060] env[69692]: INFO networking_nsxv3.common.synchronization [req-42550169-cd44-44a5-9bb9-db6ba25ddd37 req-f3e2a089-7574-4cf3-a57e-eb08a2ab53a0 tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_members [ 1065.238531] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_members [ 1065.238787] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef6eb63-26a4-4ff5-9105-ba8720b0e581 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.238903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.239027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.239575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.239575] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.239575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.239575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.239575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.239834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.239834] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.578357] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.578621] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.578753] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.579074] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.579373] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.579617] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.579677] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.579895] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.580051] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.580384] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.580513] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.580627] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.580747] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.580871] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.580984] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.581160] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.601769] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.601769] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1065.601899] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.602099] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.602426] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-90d4bf2f-db5e-419d-bc58-09872f716082 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.602643] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-90d4bf2f-db5e-419d-bc58-09872f716082" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.602933] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-90d4bf2f-db5e-419d-bc58-09872f716082" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.603617] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-90d4bf2f-db5e-419d-bc58-09872f716082" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.603617] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90d4bf2f-db5e-419d-bc58-09872f716082',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.742144] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.106270] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.106270] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.106270] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.106497] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.106608] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.106765] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 90d4bf2f-db5e-419d-bc58-09872f716082 not found, creating... [ 1066.107035] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.107201] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.107319] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.107555] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.107668] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.107947] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.108921] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.108921] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.108921] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.108921] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.109169] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 90d4bf2f-db5e-419d-bc58-09872f716082 is going to be created. [ 1066.128315] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.129510] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.129735] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.130054] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.131144] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.131144] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-90d4bf2f-db5e-419d-bc58-09872f716082" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.247175] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.750084] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.750317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.750485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.750736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.750788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.750864] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 is going to be updated. [ 1066.783871] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.785023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.785023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.785023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.785023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.793711] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: IN_PROGRESS for 2s [ 1066.941202] env[69692]: INFO networking_nsxv3.common.synchronization [req-42550169-cd44-44a5-9bb9-db6ba25ddd37 req-2c9498c0-0cfd-4a8f-b616-6d187887f0c1 service nova] Enqueued Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_rules [ 1066.945184] env[69692]: INFO networking_nsxv3.common.synchronization [req-42550169-cd44-44a5-9bb9-db6ba25ddd37 req-2c9498c0-0cfd-4a8f-b616-6d187887f0c1 service nova] Enqueued Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_members [ 1066.945184] env[69692]: INFO networking_nsxv3.common.synchronization [req-42550169-cd44-44a5-9bb9-db6ba25ddd37 req-2c9498c0-0cfd-4a8f-b616-6d187887f0c1 service nova] Enqueued Resource ID: 90d4bf2f-db5e-419d-bc58-09872f716082 with Priority: HIGHEST for action port [ 1066.945184] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_rules [ 1066.945184] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_members [ 1066.945184] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90d4bf2f-db5e-419d-bc58-09872f716082 with Priority: HIGHEST for action port [ 1066.945184] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.945555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.945714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.945996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.946178] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.947534] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef6eb63-26a4-4ff5-9105-ba8720b0e581 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.947758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.948144] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-90d4bf2f-db5e-419d-bc58-09872f716082 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.948452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90d4bf2f-db5e-419d-bc58-09872f716082" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.948601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90d4bf2f-db5e-419d-bc58-09872f716082" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.948890] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90d4bf2f-db5e-419d-bc58-09872f716082" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.949071] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90d4bf2f-db5e-419d-bc58-09872f716082',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.451798] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90d4bf2f-db5e-419d-bc58-09872f716082 with status ACTIVE [ 1067.452072] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.452179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.452337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.452483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.452538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.452715] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.452829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.452900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.453104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.453185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.453374] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.453472] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.453532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.453671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.453747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.453830] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90d4bf2f-db5e-419d-bc58-09872f716082 is going to be updated. [ 1067.455903] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef6eb63-26a4-4ff5-9105-ba8720b0e581 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.455903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.481377] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.481579] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.481761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.481892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.482069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.482848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90d4bf2f-db5e-419d-bc58-09872f716082" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.688754] env[69692]: INFO networking_nsxv3.common.synchronization [req-af27ce3e-9f60-4f58-992f-27883422cc2f req-d88ab13b-4d01-4e5a-bd5a-4dd1ad246676 tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_members [ 1067.689303] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_members [ 1067.689617] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.689737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.689808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.690085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.690247] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.690351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.690416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.690577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.690684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.690780] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.996315] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-630 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.996315] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.996503] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.996714] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.996970] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.997141] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.997261] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.997479] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.997638] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.997852] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.997966] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.998118] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.998221] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.998337] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.998448] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.998617] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.016635] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.016817] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1068.016958] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.017337] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.017665] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-3a3ee3ed-3ba7-4b9b-b95c-c97311404e35 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.017903] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-3a3ee3ed-3ba7-4b9b-b95c-c97311404e35" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.018046] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-3a3ee3ed-3ba7-4b9b-b95c-c97311404e35" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.018364] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-3a3ee3ed-3ba7-4b9b-b95c-c97311404e35" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.018509] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a3ee3ed-3ba7-4b9b-b95c-c97311404e35',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.193701] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.193855] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.193929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.194215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.194309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.194503] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.194599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.194654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.194809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.194885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.194973] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 already deleted. [ 1068.195098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.520842] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.521381] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.521381] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.521544] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.521685] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.521851] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 3a3ee3ed-3ba7-4b9b-b95c-c97311404e35 not found, creating... [ 1068.522131] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.522297] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.522428] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.522645] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.522787] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.523114] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.523283] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.523390] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.523607] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.523744] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.523885] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 3a3ee3ed-3ba7-4b9b-b95c-c97311404e35 is going to be created. [ 1068.547992] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.548231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.548361] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.548636] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.548867] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.549114] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-3a3ee3ed-3ba7-4b9b-b95c-c97311404e35" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.803293] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: SUCCESS [ 1068.803567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.803766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.804046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.804283] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.804564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.804564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.804757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.804868] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.804989] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.285259] env[69692]: INFO networking_nsxv3.common.synchronization [req-af27ce3e-9f60-4f58-992f-27883422cc2f req-a6fa7018-142c-4a19-87e8-3027b455bc27 service nova] Enqueued Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_rules [ 1069.285259] env[69692]: INFO networking_nsxv3.common.synchronization [req-af27ce3e-9f60-4f58-992f-27883422cc2f req-a6fa7018-142c-4a19-87e8-3027b455bc27 service nova] Enqueued Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_members [ 1069.285259] env[69692]: INFO networking_nsxv3.common.synchronization [req-af27ce3e-9f60-4f58-992f-27883422cc2f req-a6fa7018-142c-4a19-87e8-3027b455bc27 service nova] Enqueued Resource ID: 3a3ee3ed-3ba7-4b9b-b95c-c97311404e35 with Priority: HIGHEST for action port [ 1069.285259] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_rules [ 1069.285259] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_members [ 1069.285259] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a3ee3ed-3ba7-4b9b-b95c-c97311404e35 with Priority: HIGHEST for action port [ 1069.285259] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.285259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.285259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.285259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.285259] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.286766] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.286882] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.286946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.287145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.287292] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.287387] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.287446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.287592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.287673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.287786] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.288705] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a3ee3ed-3ba7-4b9b-b95c-c97311404e35 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.288705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a3ee3ed-3ba7-4b9b-b95c-c97311404e35" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.288705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a3ee3ed-3ba7-4b9b-b95c-c97311404e35" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.288835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a3ee3ed-3ba7-4b9b-b95c-c97311404e35" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.290023] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a3ee3ed-3ba7-4b9b-b95c-c97311404e35',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.307465] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.790731] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.792250] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.792360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.792671] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a3ee3ed-3ba7-4b9b-b95c-c97311404e35 with status ACTIVE [ 1069.792829] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.792941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.793017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.793398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.793507] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.793696] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.793802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.793868] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.794157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.794303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.794498] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.794596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.794659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.794800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.794879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.794976] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a3ee3ed-3ba7-4b9b-b95c-c97311404e35 is going to be updated. [ 1069.809305] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.815670] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.815670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.815670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.815670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.815670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.815670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a3ee3ed-3ba7-4b9b-b95c-c97311404e35" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.959603] env[69692]: INFO networking_nsxv3.common.synchronization [None req-4d6d2b5d-ac36-4ab9-89b5-38d2822321de tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c with Priority: HIGHEST for action security_group_rules [ 1069.960199] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c with Priority: HIGHEST for action security_group_rules [ 1069.960519] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.960876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.960876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.961243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.961362] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fdc28f1-77ed-4baf-84b4-15276bc8a55c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.041994] env[69692]: INFO networking_nsxv3.common.synchronization [None req-34675ae8-27e1-4a7f-beb8-8faaae16b565 tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c with Priority: HIGHEST for action security_group_rules [ 1070.042473] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c with Priority: HIGHEST for action security_group_rules [ 1070.042791] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.042895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.293436] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.312586] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.312721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.312789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.313229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.313229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.313229] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 is going to be updated. [ 1070.337824] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.337967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.338100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.338255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.338478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.349030] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: IN_PROGRESS for 2s [ 1070.480189] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.480334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.480545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.480601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.480689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.481406] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c already deleted. [ 1070.481406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.481406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.481406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.481406] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fdc28f1-77ed-4baf-84b4-15276bc8a55c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.795478] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.795773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.795773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.795918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.796056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.796124] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 is going to be created. [ 1070.819900] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.820080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.820199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.820353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.820514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.830748] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: UNINITIALIZED for 2s [ 1071.003226] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.003226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.003226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.003430] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.003430] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.003489] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c already deleted. [ 1071.003606] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.355611] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: SUCCESS [ 1072.356091] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.356091] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.356332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.356596] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.356734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.356808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.356995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.357128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.357249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.357371] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.841036] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: SUCCESS [ 1072.841302] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.841472] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.841670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.841860] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.841976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.842054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.842208] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.842312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.842406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.842496] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.859317] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.345119] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.345322] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.345416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.345596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.345780] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.346178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.346178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.346178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.346178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.346308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.346400] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.346502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.346562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.346710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.346848] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.346939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.347026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.347168] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.347260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.347345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.347432] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.361097] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bef6eb63-26a4-4ff5-9105-ba8720b0e581: rpc.has_security_group_logging(os_id): False [ 1073.377411] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.377557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.377632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.377833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.377922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.378171] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.378282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.378331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.378481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.378556] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.378639] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 is going to be updated. [ 1073.433408] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.433612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.433673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.433873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.434043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.446136] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: IN_PROGRESS for 2s [ 1073.850018] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419: rpc.has_security_group_logging(os_id): False [ 1073.867217] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.867366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.867450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.867655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.867741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.868059] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.868059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.868142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.868241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.868393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.868510] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.868601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.868664] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.868804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.868874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.869081] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.869174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.869235] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.869374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.869663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.869663] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 is going to be created. [ 1073.938731] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.938902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.938944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.939179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.939359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.948713] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: IN_PROGRESS for 2s [ 1074.081067] env[69692]: INFO networking_nsxv3.common.synchronization [req-d361a2cc-1dc0-4c0b-87a5-51eb172d65b9 req-ba4662cc-5576-4ebf-ac7c-40ee0d9dbb8d tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1074.081067] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1074.081067] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.081450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.081450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.083673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.083673] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.083673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.083673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.083673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.083673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.083673] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.429291] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.429685] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.429685] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.429888] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.430160] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.430318] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.430436] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.430653] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.430797] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.431016] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.431138] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.431256] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.431366] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.431479] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.431588] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.431727] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.450374] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.450548] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1074.450688] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.450865] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.451178] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-2119868e-fce7-4e5e-b93e-d485883645ef taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.451445] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-2119868e-fce7-4e5e-b93e-d485883645ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.451490] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-2119868e-fce7-4e5e-b93e-d485883645ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.451766] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-2119868e-fce7-4e5e-b93e-d485883645ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.451934] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2119868e-fce7-4e5e-b93e-d485883645ef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.584594] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.956739] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.957031] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.957160] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.957488] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.957665] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.957846] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 2119868e-fce7-4e5e-b93e-d485883645ef not found, creating... [ 1074.958441] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.958441] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.958584] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.958727] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.958886] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.959228] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.959397] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.959531] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.959757] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.959896] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.960075] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 2119868e-fce7-4e5e-b93e-d485883645ef is going to be created. [ 1074.978604] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.978745] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.978745] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.979058] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.979292] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.979569] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-2119868e-fce7-4e5e-b93e-d485883645ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.086869] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.460000] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: SUCCESS [ 1075.460248] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.589406] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.589682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.589811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.590172] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.590330] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.590993] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1075.621700] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.621934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.621996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.622252] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.622415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.633422] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1075.960957] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: SUCCESS [ 1075.960957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.047253] env[69692]: INFO networking_nsxv3.common.synchronization [req-d361a2cc-1dc0-4c0b-87a5-51eb172d65b9 req-5ab747a2-724c-476c-9061-c588abc18a23 service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 1076.047253] env[69692]: INFO networking_nsxv3.common.synchronization [req-d361a2cc-1dc0-4c0b-87a5-51eb172d65b9 req-5ab747a2-724c-476c-9061-c588abc18a23 service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1076.047253] env[69692]: INFO networking_nsxv3.common.synchronization [req-d361a2cc-1dc0-4c0b-87a5-51eb172d65b9 req-5ab747a2-724c-476c-9061-c588abc18a23 service nova] Enqueued Resource ID: 2119868e-fce7-4e5e-b93e-d485883645ef with Priority: HIGHEST for action port [ 1076.047416] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 1076.048550] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1076.048550] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2119868e-fce7-4e5e-b93e-d485883645ef with Priority: HIGHEST for action port [ 1076.048550] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.048550] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.048775] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.048895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.049308] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.050636] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.050769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.051013] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-2119868e-fce7-4e5e-b93e-d485883645ef taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.051205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2119868e-fce7-4e5e-b93e-d485883645ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.051353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2119868e-fce7-4e5e-b93e-d485883645ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.051559] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2119868e-fce7-4e5e-b93e-d485883645ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.051672] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2119868e-fce7-4e5e-b93e-d485883645ef',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.551951] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.552363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.553557] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2119868e-fce7-4e5e-b93e-d485883645ef with status ACTIVE [ 1076.553723] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.553844] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.553915] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.554191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.554305] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.554494] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.554596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.554661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.554826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.554904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.555100] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.555213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.555253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.555392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.555525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.555568] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2119868e-fce7-4e5e-b93e-d485883645ef is going to be updated. [ 1076.574605] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.574605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.574788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.574959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.575128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.575292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2119868e-fce7-4e5e-b93e-d485883645ef" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.733846] env[69692]: INFO networking_nsxv3.common.synchronization [None req-6e937b4e-dce4-4c14-91ba-fd10d69e7d90 tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 1076.734534] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 1076.734805] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.734973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.735029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.735229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.735395] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.735505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.735584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.735779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.735823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.735918] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.240829] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.240829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.240829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.240829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.268039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.268039] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.268039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.268039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.268039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.268039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.268039] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 1077.296146] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.296146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.296146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.296146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.296146] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.299584] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 1077.643366] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1077.643628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.643628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.643793] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.644021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.644144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.644253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.644411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.644494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.644608] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.681866] env[69692]: INFO networking_nsxv3.common.synchronization [req-120e7428-ba09-4431-a6c2-e044455fa0de req-4b8cc696-4fc6-49b9-ae60-3ee617596e50 tempest-ImagesOneServerNegativeTestJSON-1823576721 tempest-ImagesOneServerNegativeTestJSON-1823576721-project-member] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1077.682430] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1077.682736] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.682861] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.682912] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.683577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.683577] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.683577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.683824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.683824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.683915] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.683989] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.081465] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.081465] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-815" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.081465] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-815" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.081760] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-815" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.082038] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.084134] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.084134] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.084134] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.084134] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.084134] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.084134] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.084134] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.084134] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.084134] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.084134] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.084134] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.104828] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.104828] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1078.104828] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.104828] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-815" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.104828] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-8d8b680c-4c59-4f96-8f4f-2eaba4bc2164 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.104828] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-8d8b680c-4c59-4f96-8f4f-2eaba4bc2164" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.104828] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-8d8b680c-4c59-4f96-8f4f-2eaba4bc2164" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.104828] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-8d8b680c-4c59-4f96-8f4f-2eaba4bc2164" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.104828] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d8b680c-4c59-4f96-8f4f-2eaba4bc2164',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.147821] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.186823] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.186984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.187096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.187651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.187808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.188132] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.188379] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.188524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.188769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.188923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.188923] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 is going to be updated. [ 1078.220465] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.220634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.220700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.222030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.222030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.229383] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: IN_PROGRESS for 2s [ 1078.610024] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.610024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.610024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.610024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.610024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.610024] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 8d8b680c-4c59-4f96-8f4f-2eaba4bc2164 not found, creating... [ 1078.610024] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.610024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.610024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.610662] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.610990] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.611503] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.611883] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.612209] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.612603] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.612933] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.613268] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 8d8b680c-4c59-4f96-8f4f-2eaba4bc2164 is going to be created. [ 1078.633499] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.633499] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.633499] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.633499] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.633499] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.633499] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-8d8b680c-4c59-4f96-8f4f-2eaba4bc2164" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.650686] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.963890] env[69692]: INFO networking_nsxv3.common.synchronization [req-49ad8f1b-1b1b-4476-b20d-3a07539503a7 req-41a9fc79-d334-4eb8-8cb3-763ae03a878e tempest-ServerRescueNegativeTestJSON-8223595 tempest-ServerRescueNegativeTestJSON-8223595-project-member] Enqueued Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_members [ 1078.964563] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_members [ 1078.964893] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.965029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.965099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.965320] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.965493] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.965607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.965697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.965936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.966093] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.966212] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.153931] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.153931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.154040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.154870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.154870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.154870] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1079.180375] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.180514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.180586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.180797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.180937] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.191295] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1079.312689] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 1079.313067] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b deletion is rescheduled due to dependency. [ 1079.313266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.328312] env[69692]: INFO networking_nsxv3.common.synchronization [req-120e7428-ba09-4431-a6c2-e044455fa0de req-2bc08cdd-8c08-4b47-901b-019241dcc9a1 service nova] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_rules [ 1079.328489] env[69692]: INFO networking_nsxv3.common.synchronization [req-120e7428-ba09-4431-a6c2-e044455fa0de req-2bc08cdd-8c08-4b47-901b-019241dcc9a1 service nova] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1079.329374] env[69692]: INFO networking_nsxv3.common.synchronization [req-120e7428-ba09-4431-a6c2-e044455fa0de req-2bc08cdd-8c08-4b47-901b-019241dcc9a1 service nova] Enqueued Resource ID: 8d8b680c-4c59-4f96-8f4f-2eaba4bc2164 with Priority: HIGHEST for action port [ 1079.329374] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_rules [ 1079.329374] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1079.329374] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d8b680c-4c59-4f96-8f4f-2eaba4bc2164 with Priority: HIGHEST for action port [ 1079.329637] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.329811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.329845] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.330186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.330297] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.331136] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.331256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.331464] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d8b680c-4c59-4f96-8f4f-2eaba4bc2164 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.331558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d8b680c-4c59-4f96-8f4f-2eaba4bc2164" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.331620] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d8b680c-4c59-4f96-8f4f-2eaba4bc2164" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.331794] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d8b680c-4c59-4f96-8f4f-2eaba4bc2164" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.331994] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d8b680c-4c59-4f96-8f4f-2eaba4bc2164',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.467933] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.834300] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d8b680c-4c59-4f96-8f4f-2eaba4bc2164 with status ACTIVE [ 1079.834747] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.834747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.834876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.835284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.835284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.835372] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.835433] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.835472] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.835703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.835777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.835902] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.836026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.836095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.836884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.836963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.837265] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d8b680c-4c59-4f96-8f4f-2eaba4bc2164 is going to be updated. [ 1079.839089] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.839243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.860854] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.861032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.861112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.861364] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.861538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.861762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d8b680c-4c59-4f96-8f4f-2eaba4bc2164" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.973094] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.189755] env[69692]: INFO networking_nsxv3.common.synchronization [req-d248591a-abc9-4c75-ab73-f6dafa34e8bd req-1ab18e95-1fba-413a-a922-e85a2355fc46 tempest-DeleteServersTestJSON-207338121 tempest-DeleteServersTestJSON-207338121-project-member] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1080.190308] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1080.190609] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.190729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.190796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.191018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.191185] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.191282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.191338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.191494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.191584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.191670] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.242501] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: SUCCESS [ 1080.242501] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 deletion is rescheduled due to dependency. [ 1080.242501] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.242604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.242764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.243038] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.243086] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.243113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.243326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.243410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.243510] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.475501] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.475674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.476268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.476268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.476268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.476268] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9debc847-a741-46fa-9447-b1070c70a885 is going to be updated. [ 1080.505546] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.505694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.505754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.505958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.506118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.515522] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: IN_PROGRESS for 2s [ 1080.554065] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.554065] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.554065] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.554065] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.554065] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.554530] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.554806] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.558024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.558024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.558024] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.558024] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.558024] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.558024] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.558024] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.558024] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.558024] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.574781] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.574877] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1080.575020] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.575184] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.575521] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-b06143ac-6054-4509-b92d-3d52e2a84806 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.575741] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-b06143ac-6054-4509-b92d-3d52e2a84806" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.575880] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-b06143ac-6054-4509-b92d-3d52e2a84806" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.576241] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-b06143ac-6054-4509-b92d-3d52e2a84806" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.576385] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b06143ac-6054-4509-b92d-3d52e2a84806',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.695108] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.695307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.695428] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.695707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.695841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.696090] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.696228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.696438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.696975] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.697092] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.697788] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1080.725847] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.726088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.726172] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.726396] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.726554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.734879] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1080.745306] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.079516] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.079816] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.079816] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.080111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.080350] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.080935] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port b06143ac-6054-4509-b92d-3d52e2a84806 not found, creating... [ 1081.080935] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.081115] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.081115] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.081373] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.081510] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.081795] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.081956] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.082093] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.082310] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.082451] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.082594] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: b06143ac-6054-4509-b92d-3d52e2a84806 is going to be created. [ 1081.102138] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.102657] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.102657] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.102751] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.103124] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.103364] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-b06143ac-6054-4509-b92d-3d52e2a84806" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.200739] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1081.200979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.201282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.201552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.201755] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.201878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.201943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.202130] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.202207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.202295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.202388] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.246961] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.708566] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.708566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.708566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.708566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.708566] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.708566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.708566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.708566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.708566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.708566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.708566] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.708566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.708566] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.709884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.710478] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.710806] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.711082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.711874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.711874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.711874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.712256] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.749730] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.751104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.751104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.751104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.751104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.751104] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 is going to be updated. [ 1081.784496] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.784715] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.784715] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.785718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.785718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.793232] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: IN_PROGRESS for 2s [ 1081.935856] env[69692]: INFO networking_nsxv3.common.synchronization [req-d248591a-abc9-4c75-ab73-f6dafa34e8bd req-95ccf797-eeb1-493e-9286-e045b80d4ca3 service nova] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_rules [ 1081.936196] env[69692]: INFO networking_nsxv3.common.synchronization [req-d248591a-abc9-4c75-ab73-f6dafa34e8bd req-95ccf797-eeb1-493e-9286-e045b80d4ca3 service nova] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1081.936414] env[69692]: INFO networking_nsxv3.common.synchronization [req-d248591a-abc9-4c75-ab73-f6dafa34e8bd req-95ccf797-eeb1-493e-9286-e045b80d4ca3 service nova] Enqueued Resource ID: b06143ac-6054-4509-b92d-3d52e2a84806 with Priority: HIGHEST for action port [ 1081.936972] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_rules [ 1081.940632] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1081.940797] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b06143ac-6054-4509-b92d-3d52e2a84806 with Priority: HIGHEST for action port [ 1081.941163] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.941352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.941440] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.941714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.941794] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.942967] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.943082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.943695] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-b06143ac-6054-4509-b92d-3d52e2a84806 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.943695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b06143ac-6054-4509-b92d-3d52e2a84806" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.943695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b06143ac-6054-4509-b92d-3d52e2a84806" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.943695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b06143ac-6054-4509-b92d-3d52e2a84806" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.943695] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b06143ac-6054-4509-b92d-3d52e2a84806',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.215163] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eab15f99-d56d-4017-8640-5d7acb890c08: rpc.has_security_group_logging(os_id): False [ 1082.237751] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.238155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.238155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.238366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.238433] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.238642] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.238767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.238838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.239013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.239090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.239312] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.239408] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.239489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.239655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.239745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.239925] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.240072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.240072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.240230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.240301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.240369] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1082.305864] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.306114] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.306223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.306526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.306763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.323581] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1082.446153] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b06143ac-6054-4509-b92d-3d52e2a84806 with status ACTIVE [ 1082.446393] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.446531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.446642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.446817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.446908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.447527] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.447527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.447527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.447527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.447527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.447758] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.447758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.447833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.447929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.448010] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.448098] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b06143ac-6054-4509-b92d-3d52e2a84806 is going to be updated. [ 1082.449255] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.449348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.472145] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.472291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.472363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.472576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.472707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.472943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b06143ac-6054-4509-b92d-3d52e2a84806" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.525031] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: SUCCESS [ 1082.525360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.682353] env[69692]: INFO networking_nsxv3.common.synchronization [req-f8182a94-5f1d-40a1-a09b-fe5772044bf9 req-6cf0f837-45ff-4354-86c9-3ecfe74d3d8c tempest-ImagesTestJSON-510458365 tempest-ImagesTestJSON-510458365-project-member] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1082.682552] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1082.682867] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.682990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.683220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.683481] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.683642] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.683748] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.683832] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.683960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.684054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.684144] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.746016] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1082.747097] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 deletion is rescheduled due to dependency. [ 1082.747097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.747097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.747335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.747488] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.747674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.747767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.748024] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.748140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.748289] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.987907] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.988195] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.988331] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.988616] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.988891] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.989111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.989245] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.989481] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.989630] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.989856] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1082.989974] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.990100] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.990212] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.990323] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1082.990433] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.990570] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.011392] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.011646] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1083.011850] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.012121] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.012574] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-e144a4b5-d74a-4469-a2ac-deb2046e7b99 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.012840] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-e144a4b5-d74a-4469-a2ac-deb2046e7b99" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.013483] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-e144a4b5-d74a-4469-a2ac-deb2046e7b99" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.013597] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-e144a4b5-d74a-4469-a2ac-deb2046e7b99" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.013786] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e144a4b5-d74a-4469-a2ac-deb2046e7b99',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.186660] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.250802] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.517904] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.517904] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.517904] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.518163] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.518206] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.518349] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port e144a4b5-d74a-4469-a2ac-deb2046e7b99 not found, creating... [ 1083.518633] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.518882] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.519037] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.519275] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.519429] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.519721] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.519881] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.520010] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.520246] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.520390] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.520535] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: e144a4b5-d74a-4469-a2ac-deb2046e7b99 is going to be created. [ 1083.538740] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.538930] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.539069] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.539395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.539649] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.539895] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-e144a4b5-d74a-4469-a2ac-deb2046e7b99" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.690723] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.752694] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.803813] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: SUCCESS [ 1083.803813] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.803813] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.803995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.804054] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.804572] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.804637] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.805263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.805263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.805263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.805263] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.195853] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.196008] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.196092] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.196309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.196404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.196503] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 1084.244378] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.244571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.244735] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.244972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.245072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.253597] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 1084.255113] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.255246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.255316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.255526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.255616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.255713] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1084.279393] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.279582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.279624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.279885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.280050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.288122] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1084.307812] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.307953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.308037] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.308258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.308606] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.308734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.308798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.308950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.309049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.309135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.309459] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.309581] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.309727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.309887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.310046] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.310140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.310202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.310342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.310570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.310738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.310840] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.336906] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1084.336906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.400853] env[69692]: INFO networking_nsxv3.common.synchronization [req-f8182a94-5f1d-40a1-a09b-fe5772044bf9 req-31e67626-bed5-482c-b8b1-3b088a4f5c30 service nova] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_rules [ 1084.401094] env[69692]: INFO networking_nsxv3.common.synchronization [req-f8182a94-5f1d-40a1-a09b-fe5772044bf9 req-31e67626-bed5-482c-b8b1-3b088a4f5c30 service nova] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1084.401278] env[69692]: INFO networking_nsxv3.common.synchronization [req-f8182a94-5f1d-40a1-a09b-fe5772044bf9 req-31e67626-bed5-482c-b8b1-3b088a4f5c30 service nova] Enqueued Resource ID: e144a4b5-d74a-4469-a2ac-deb2046e7b99 with Priority: HIGHEST for action port [ 1084.401939] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_rules [ 1084.402332] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1084.402487] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e144a4b5-d74a-4469-a2ac-deb2046e7b99 with Priority: HIGHEST for action port [ 1084.402840] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.402987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.403075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.403285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.403381] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.404698] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.404698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.404838] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-e144a4b5-d74a-4469-a2ac-deb2046e7b99 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.404941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e144a4b5-d74a-4469-a2ac-deb2046e7b99" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.404941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e144a4b5-d74a-4469-a2ac-deb2046e7b99" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.405147] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e144a4b5-d74a-4469-a2ac-deb2046e7b99" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.405222] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e144a4b5-d74a-4469-a2ac-deb2046e7b99',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.813605] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06b41f20-e9f6-4dd0-84af-8ce8a036eff7: rpc.has_security_group_logging(os_id): False [ 1084.834107] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.834408] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.834530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.834829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.834973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.835247] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.835409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.835525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.835753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.835880] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.836183] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.836404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.836490] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.836649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.836777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.837056] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.837216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.837331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.837529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.837651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.837788] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 is going to be updated. [ 1084.896847] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.897007] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.897088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.897294] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.897441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.909453] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.909718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.909806] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e144a4b5-d74a-4469-a2ac-deb2046e7b99 with status ACTIVE [ 1084.909921] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.910055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.910119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.910299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.910582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.910582] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.910701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.910701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.910867] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.910904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.911094] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.911188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.911243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.911413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.911493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.911575] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e144a4b5-d74a-4469-a2ac-deb2046e7b99 is going to be updated. [ 1084.916202] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: IN_PROGRESS for 2s [ 1084.935253] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.935417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.935495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.935745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.936043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.936192] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e144a4b5-d74a-4469-a2ac-deb2046e7b99" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.886115] env[69692]: INFO networking_nsxv3.common.synchronization [req-f99b93ff-faba-4974-adcb-bf1aa3daab27 req-0381e780-a364-49f4-be9c-e398dcfb7a47 tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c with Priority: HIGHEST for action security_group_members [ 1085.886636] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c with Priority: HIGHEST for action security_group_members [ 1085.886991] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.887145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.887212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.887467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.887622] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.887719] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.890854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.890854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.890854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.890854] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fdc28f1-77ed-4baf-84b4-15276bc8a55c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.264814] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1086.265054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.265221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.265441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.265619] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.265756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.265874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.265962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.266056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.266149] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.271451] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.271530] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.272376] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.272376] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.272376] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.272376] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.272620] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.272745] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.272892] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.273314] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1086.273474] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1086.273605] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1086.273715] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1086.273846] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1086.273953] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1086.274107] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1086.292667] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1086.293058] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1086.293058] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1086.293213] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.296166] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-847ba884-1d01-41b1-99e4-94af3087f683 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.296166] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-847ba884-1d01-41b1-99e4-94af3087f683" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.296166] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-847ba884-1d01-41b1-99e4-94af3087f683" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.296166] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-847ba884-1d01-41b1-99e4-94af3087f683" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.296166] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('847ba884-1d01-41b1-99e4-94af3087f683',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.298157] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1086.298349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.298524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.300360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.300360] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.300360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.300360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.300360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.300360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.300360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.300360] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.390154] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.390393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.390463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.390726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.390878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.391097] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.391264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.391333] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.391513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.391587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.391685] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c already deleted. [ 1086.391780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.527471] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.528483] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.528717] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.529236] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.529431] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.529685] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.529822] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.530222] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.530331] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.530580] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1086.530724] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1086.530891] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1086.531064] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1086.531469] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1086.531469] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1086.531632] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1086.552155] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1086.552155] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1086.552155] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1086.552155] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.552155] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.552155] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.552155] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.552155] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.552757] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eacaa48-89b4-4a3f-a3c4-3346493c02f6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.769036] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.797832] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.798085] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.798218] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.798532] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.798666] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.798829] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 847ba884-1d01-41b1-99e4-94af3087f683 not found, creating... [ 1086.799106] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.799270] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.799425] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.799622] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.799764] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.800096] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.800218] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.800339] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.800556] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.800708] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.800851] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 847ba884-1d01-41b1-99e4-94af3087f683 is going to be created. [ 1086.802442] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.802557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.802632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.802817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.803078] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.803187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.803292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.803576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.803612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.803692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.803843] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.803936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.803997] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.804227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.804371] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.804502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.804554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.804710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.804797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.805134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.805134] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.834883] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.835110] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.839016] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.839016] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.839016] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.839016] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-847ba884-1d01-41b1-99e4-94af3087f683" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.936847] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: SUCCESS [ 1086.937179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.056291] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.056545] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.056697] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.056981] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.057166] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.057330] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 8eacaa48-89b4-4a3f-a3c4-3346493c02f6 not found, creating... [ 1087.057610] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.057785] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.057916] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.058177] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.058332] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.058636] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.058810] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.058934] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.059187] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.059329] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.059564] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 8eacaa48-89b4-4a3f-a3c4-3346493c02f6 is going to be created. [ 1087.086689] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.086914] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.087061] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.087342] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.087578] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.087812] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.272918] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.307785] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 532815ef-03c8-40fb-91ab-292fc1c769b2: rpc.has_security_group_logging(os_id): False [ 1087.327455] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.327587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.327663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.327879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.327971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.328205] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.328303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.328368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.328521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.328601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.328777] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.328871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.328933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.329089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.329171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.329348] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.329440] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.329501] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.329640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.329714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.329798] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1087.409287] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.409483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.409578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.409831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.410020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.425592] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1087.529586] env[69692]: INFO networking_nsxv3.common.synchronization [req-f99b93ff-faba-4974-adcb-bf1aa3daab27 req-abe20a4c-1dbc-4d0f-9e15-77a9943462e8 service nova] Enqueued Resource ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c with Priority: HIGHEST for action security_group_rules [ 1087.529775] env[69692]: INFO networking_nsxv3.common.synchronization [req-f99b93ff-faba-4974-adcb-bf1aa3daab27 req-abe20a4c-1dbc-4d0f-9e15-77a9943462e8 service nova] Enqueued Resource ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c with Priority: HIGHEST for action security_group_members [ 1087.529920] env[69692]: INFO networking_nsxv3.common.synchronization [req-f99b93ff-faba-4974-adcb-bf1aa3daab27 req-abe20a4c-1dbc-4d0f-9e15-77a9943462e8 service nova] Enqueued Resource ID: 847ba884-1d01-41b1-99e4-94af3087f683 with Priority: HIGHEST for action port [ 1087.530485] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c with Priority: HIGHEST for action security_group_rules [ 1087.530586] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c with Priority: HIGHEST for action security_group_members [ 1087.530687] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 847ba884-1d01-41b1-99e4-94af3087f683 with Priority: HIGHEST for action port [ 1087.530971] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.532909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.533061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.533363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.533493] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fdc28f1-77ed-4baf-84b4-15276bc8a55c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.534706] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.535193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.535292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.535484] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.535648] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.535759] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.535824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.535974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.536071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.536162] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fdc28f1-77ed-4baf-84b4-15276bc8a55c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.536924] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-847ba884-1d01-41b1-99e4-94af3087f683 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.537073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-847ba884-1d01-41b1-99e4-94af3087f683" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.537128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-847ba884-1d01-41b1-99e4-94af3087f683" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.537262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-847ba884-1d01-41b1-99e4-94af3087f683" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.537481] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('847ba884-1d01-41b1-99e4-94af3087f683',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.774732] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.774802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.774875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.775136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.775233] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.775337] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 1087.802719] env[69692]: INFO networking_nsxv3.common.synchronization [req-8b7b6ba8-98e1-437b-984a-3625749afe67 req-357bc119-5c05-45ad-ae82-e662d8aeeaed service nova] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_rules [ 1087.802870] env[69692]: INFO networking_nsxv3.common.synchronization [req-8b7b6ba8-98e1-437b-984a-3625749afe67 req-357bc119-5c05-45ad-ae82-e662d8aeeaed service nova] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 1087.802998] env[69692]: INFO networking_nsxv3.common.synchronization [req-8b7b6ba8-98e1-437b-984a-3625749afe67 req-357bc119-5c05-45ad-ae82-e662d8aeeaed service nova] Enqueued Resource ID: 8eacaa48-89b4-4a3f-a3c4-3346493c02f6 with Priority: HIGHEST for action port [ 1087.803252] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_rules [ 1087.803407] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 1087.803529] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eacaa48-89b4-4a3f-a3c4-3346493c02f6 with Priority: HIGHEST for action port [ 1087.804157] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.804289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.804386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.804551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.804631] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.805465] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.805578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.805642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.805815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.805990] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.806098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.806156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.806300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.806381] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.807438] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.808212] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.808324] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.808391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.808545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.808621] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eacaa48-89b4-4a3f-a3c4-3346493c02f6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.815144] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.815280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.815465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.815543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.815787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.829498] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 1087.909033] env[69692]: INFO networking_nsxv3.common.synchronization [req-2c43c413-c6dd-41ee-b2c3-b8ab883d8df4 req-82d6dbad-1551-4127-8e43-e0bfb42917a4 tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1087.909509] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1087.909814] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.909934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.910015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.910218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.910367] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.910463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.910524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.910667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.910748] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.910839] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.038636] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.038960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.040457] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fdc28f1-77ed-4baf-84b4-15276bc8a55c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.041412] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 847ba884-1d01-41b1-99e4-94af3087f683 with status ACTIVE [ 1088.042184] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.042184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.042184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.042184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.042184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.042391] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.042391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.042391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.042536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.042610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.042783] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.042874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.042934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.043084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.043197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.043303] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 847ba884-1d01-41b1-99e4-94af3087f683 is going to be updated. [ 1088.065430] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.065591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.065664] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.065864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.066078] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.066162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-847ba884-1d01-41b1-99e4-94af3087f683" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.312331] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.318474] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.318593] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.318767] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8eacaa48-89b4-4a3f-a3c4-3346493c02f6 with status ACTIVE [ 1088.318940] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.319084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.319151] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.319386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.319480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.319724] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.319896] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.320037] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.320306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.320479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.320801] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.320971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.321087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.321332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.321458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.321600] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8eacaa48-89b4-4a3f-a3c4-3346493c02f6 is going to be updated. [ 1088.343709] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.343945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.343945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.344136] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.344263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.344430] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.413258] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.546130] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fdc28f1-77ed-4baf-84b4-15276bc8a55c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.814963] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.918070] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.049252] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.049873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.050680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.051059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.051615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.055293] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c is going to be created. [ 1089.080209] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.080209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.080209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.080209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.080209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.087158] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c in Status: UNINITIALIZED for 2s [ 1089.319737] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.319737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.319737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.319737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.319737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.319737] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 1089.343729] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.344662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.344662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.344779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.345190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.352581] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 1089.420386] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.420565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.420614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.420835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.420926] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.421041] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1089.440198] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1089.440429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.449661] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.449875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.449875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.450099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.450241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.464643] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1089.840069] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1089.840318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.840504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.840717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.840907] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.841034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.841098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.841257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.841343] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.841454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.841568] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.344274] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.344649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.344649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.344867] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.345123] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.345265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.345348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.345543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.345654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.345781] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.345981] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.346129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.346218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.346443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.346609] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.346771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.346864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.347062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.347159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.347274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.347417] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.850385] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 480fedb1-b714-4d98-8f62-8eca0ff3855e: rpc.has_security_group_logging(os_id): False [ 1090.869782] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.869782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.869782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.870106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.870106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.870257] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.870425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.870588] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.870836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.870933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.871727] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.871727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.871727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.871727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.871983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.871983] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.872139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.872196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.872594] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.872699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.872774] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 1090.929664] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.929823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.929914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.930183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.930316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.943691] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 1091.096401] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c in Status: SUCCESS [ 1091.096777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.097069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.097409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.097735] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.097938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.098021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.098247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.098382] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.098518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.098670] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fdc28f1-77ed-4baf-84b4-15276bc8a55c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.362324] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 1091.362557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.362588] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.362816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.363053] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.363177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.363244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.363444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.363546] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.363636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.363727] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.473927] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1091.474214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.601689] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fdc28f1-77ed-4baf-84b4-15276bc8a55c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.866452] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.866659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.866739] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.866981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.867200] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.867326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.867391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.867577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.867720] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.867860] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.868066] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.868171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.868236] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.868384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.868621] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.868621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.868715] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.868821] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.868899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.868985] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.869850] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.953037] env[69692]: INFO networking_nsxv3.common.synchronization [req-8315357c-30c0-471c-9d54-a31f22fd77ee req-bafe6007-8813-4a9f-be36-98f0a127a64c tempest-ServerDiskConfigTestJSON-756528476 tempest-ServerDiskConfigTestJSON-756528476-project-member] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1091.953683] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1091.954025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.954149] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.954217] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.954451] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.954579] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.954665] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.954752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.954870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.954953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.955057] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.105790] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fdc28f1-77ed-4baf-84b4-15276bc8a55c: rpc.has_security_group_logging(os_id): False [ 1092.125787] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.126063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.126167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.126415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.126552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.126965] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.127173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.127282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.127441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.127563] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.127669] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c is going to be created. [ 1092.264827] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.264827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.264827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.265088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.265268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.278884] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c in Status: IN_PROGRESS for 2s [ 1092.376434] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0602c86f-34c6-42e5-a101-35f6c95de05b: rpc.has_security_group_logging(os_id): False [ 1092.408630] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.408630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.408630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.408630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.408940] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.408940] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.409083] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.409132] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.409294] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.409374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.409568] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.409686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.409752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.409971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.409971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.410315] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.410486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.410530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.410684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.410806] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.410903] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 1092.457128] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.457348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.457395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.457606] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.457704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.457913] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.458025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.458091] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.458255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.458334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.458439] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 1092.480179] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.480369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.480422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.480683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.480856] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.492768] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.492768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.492768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.492768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.492952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.497602] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 1092.501518] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 1092.958763] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1092.958930] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.295635] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c in Status: SUCCESS [ 1094.296062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.509457] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 1094.509682] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 deletion is rescheduled due to dependency. [ 1094.509818] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.511304] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 1094.511507] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.139068] env[69692]: INFO networking_nsxv3.common.synchronization [req-5d882871-d066-405b-9cbd-56cdab68517f req-197efd8a-1cd8-403c-a69a-4c8d49463b59 tempest-DeleteServersTestJSON-207338121 tempest-DeleteServersTestJSON-207338121-project-member] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1096.139733] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1096.139940] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.140084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.140152] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.140351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.140507] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.140608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.140668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.140812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.140926] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.140984] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.644752] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.644752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.644966] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.645104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.645211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.645415] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.645515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.645584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.645747] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.645848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.645939] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1096.673178] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.673359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.673359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.673752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.673925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.681621] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1097.979643] env[69692]: INFO networking_nsxv3.common.synchronization [req-a71660a1-a910-45cd-bf0c-e2104b064e65 req-fc82d964-af82-43ee-8ec5-b3f52a0150ad tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_members [ 1097.980766] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_members [ 1097.980766] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.980766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.980766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.980766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.980766] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.981125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.981125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.981125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.981125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.981241] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.483326] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.483495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.483654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.483879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.483971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.484188] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.484292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.484355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.484512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.484602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.484693] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 is going to be updated. [ 1098.509196] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.509410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.509410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.509510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.509651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.521837] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: IN_PROGRESS for 2s [ 1098.619193] env[69692]: INFO networking_nsxv3.common.synchronization [req-a38866f0-c65c-480b-9c85-6528804b0ff0 req-17d39162-2651-4f3b-be71-182b7c3b3f97 tempest-ServerRescueNegativeTestJSON-8223595 tempest-ServerRescueNegativeTestJSON-8223595-project-member] Enqueued Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_members [ 1098.619764] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9debc847-a741-46fa-9447-b1070c70a885 with Priority: HIGHEST for action security_group_members [ 1098.620473] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-9debc847-a741-46fa-9447-b1070c70a885 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.620647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.620733] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.621076] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.621260] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.621435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.621553] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.621814] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.621967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.622553] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9debc847-a741-46fa-9447-b1070c70a885',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.694660] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1098.694660] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 deletion is rescheduled due to dependency. [ 1098.694827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.124306] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.124697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.124697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.124854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.146563] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.146920] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.147071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.147071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.147281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.147374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.147486] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9debc847-a741-46fa-9447-b1070c70a885 is going to be updated. [ 1099.169243] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.169379] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.169457] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.169672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.169812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.177257] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: IN_PROGRESS for 2s [ 1099.590663] env[69692]: INFO networking_nsxv3.common.synchronization [req-2e543c14-0ef0-4847-b5a8-eb0885c66af4 req-95a1bed0-87e7-4687-911e-636f811c01ad tempest-ServerDiskConfigTestJSON-756528476 tempest-ServerDiskConfigTestJSON-756528476-project-member] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1099.591216] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1099.591548] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.591672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.591738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.591931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.592149] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.592470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.592470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.592470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.592591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.592623] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.984836] env[69692]: INFO networking_nsxv3.common.synchronization [req-8eb741fd-1a06-47af-a961-0d1667653567 req-4aa8a9b0-f094-490b-87f6-534237cf2e9f tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1099.985427] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1099.986047] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.986047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.986047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.986254] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.986288] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.986379] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.986442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.986584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.986668] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.986760] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.003092] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.003092] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.003092] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.003092] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.003092] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.003311] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.003464] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.003637] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.003799] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.004017] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1100.004537] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.004671] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.004855] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.004898] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1100.005021] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.005166] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.023386] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.023595] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1100.024132] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.024132] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-617" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.024243] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-9dbcf627-59c5-4552-b1d3-9f8c3bff9332 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.024398] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-9dbcf627-59c5-4552-b1d3-9f8c3bff9332" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.024532] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-9dbcf627-59c5-4552-b1d3-9f8c3bff9332" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.024899] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-9dbcf627-59c5-4552-b1d3-9f8c3bff9332" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.025082] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dbcf627-59c5-4552-b1d3-9f8c3bff9332',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.094876] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.095056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.095167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.095341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.095433] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.095621] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.095717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.096230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.096230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.096230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.096230] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 1100.119928] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.120129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.120209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.120458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.120706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.128741] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 1100.488400] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.526933] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: SUCCESS [ 1100.527688] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 deletion is rescheduled due to dependency. [ 1100.527688] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.527773] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.528438] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.528438] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.528438] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.528586] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.528642] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 9dbcf627-59c5-4552-b1d3-9f8c3bff9332 not found, creating... [ 1100.528896] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.529123] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.529190] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.529410] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.529555] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.530167] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.530167] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.530167] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.530350] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.530439] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.530605] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 9dbcf627-59c5-4552-b1d3-9f8c3bff9332 is going to be created. [ 1100.549877] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.549877] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.549877] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.550159] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.550421] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.550596] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-9dbcf627-59c5-4552-b1d3-9f8c3bff9332" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.993152] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.187930] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9debc847-a741-46fa-9447-b1070c70a885 in Status: SUCCESS [ 1101.188303] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9debc847-a741-46fa-9447-b1070c70a885 deletion is rescheduled due to dependency. [ 1101.188303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9debc847-a741-46fa-9447-b1070c70a885" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.331492] env[69692]: INFO networking_nsxv3.common.synchronization [req-2e543c14-0ef0-4847-b5a8-eb0885c66af4 req-6afdf37d-acb8-42fc-a4fa-78ea8227be6a service nova] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_rules [ 1101.331760] env[69692]: INFO networking_nsxv3.common.synchronization [req-2e543c14-0ef0-4847-b5a8-eb0885c66af4 req-6afdf37d-acb8-42fc-a4fa-78ea8227be6a service nova] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1101.331981] env[69692]: INFO networking_nsxv3.common.synchronization [req-2e543c14-0ef0-4847-b5a8-eb0885c66af4 req-6afdf37d-acb8-42fc-a4fa-78ea8227be6a service nova] Enqueued Resource ID: 9dbcf627-59c5-4552-b1d3-9f8c3bff9332 with Priority: HIGHEST for action port [ 1101.334118] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_rules [ 1101.334316] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1101.334943] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dbcf627-59c5-4552-b1d3-9f8c3bff9332 with Priority: HIGHEST for action port [ 1101.335476] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.335663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.335768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.336064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.336191] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.337350] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.337457] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.337729] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dbcf627-59c5-4552-b1d3-9f8c3bff9332 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.337878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dbcf627-59c5-4552-b1d3-9f8c3bff9332" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.338065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dbcf627-59c5-4552-b1d3-9f8c3bff9332" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.338339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dbcf627-59c5-4552-b1d3-9f8c3bff9332" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.338463] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dbcf627-59c5-4552-b1d3-9f8c3bff9332',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.495355] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.495570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.495672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.495953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.496461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.496633] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1101.522779] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.522779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.522779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.523046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.523108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.531562] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1101.831237] env[69692]: INFO networking_nsxv3.common.synchronization [req-8d525334-2849-48a8-896b-11604e3b2ea7 req-cb186eb6-3c56-44b9-8cc3-4810a19d3015 tempest-ImagesOneServerNegativeTestJSON-1823576721 tempest-ImagesOneServerNegativeTestJSON-1823576721-project-member] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1101.831725] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1101.832039] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.832166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.832234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.832435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.832600] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.832673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.832732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.832953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.833171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.833171] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.840160] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.840160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.841278] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9dbcf627-59c5-4552-b1d3-9f8c3bff9332 with status ACTIVE [ 1101.841360] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.841473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.841534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.841762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.841818] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.841974] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.842081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.842140] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.842284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.842358] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.842532] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.842620] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.842676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.843167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.843167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.843167] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9dbcf627-59c5-4552-b1d3-9f8c3bff9332 is going to be updated. [ 1101.861973] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.862141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.862213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.862515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.862626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.862686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dbcf627-59c5-4552-b1d3-9f8c3bff9332" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.138985] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 1102.139473] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 deletion is rescheduled due to dependency. [ 1102.139765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.139941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.140168] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.140353] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.140472] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.140537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.140701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.140844] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.140894] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.338335] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.338686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.338686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.338850] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.338936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.339065] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.339164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.339227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.339377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.339454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.339542] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 is going to be updated. [ 1102.364437] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.364594] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.364731] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.364854] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.364995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.374075] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: IN_PROGRESS for 2s [ 1102.643374] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.078838] env[69692]: INFO networking_nsxv3.common.synchronization [req-8ab398ea-2315-4cd9-b116-486d5b70697b req-84d7b2e2-7c79-4421-a1a9-049a78752712 tempest-ImagesTestJSON-510458365 tempest-ImagesTestJSON-510458365-project-member] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1103.078838] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1103.079740] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.079740] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.080069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.080069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.080172] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.080325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.080374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.080975] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.081341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.081341] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.148746] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.542190] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1103.542759] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.585590] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.652036] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.652036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.652036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.652036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.652036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.652036] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 1103.688942] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.689167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.689246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.689549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.689763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.699922] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 1104.087696] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.383188] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: SUCCESS [ 1104.384388] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 deletion is rescheduled due to dependency. [ 1104.384388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.537234] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.537234] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.537234] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.537234] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.537234] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.537234] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.537234] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.538083] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.538351] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.538660] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.538952] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.539176] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.539924] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.540702] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.540702] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.540702] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.558082] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.558315] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1104.558386] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.558563] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-482" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.558863] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.559051] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.559177] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.559443] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.559579] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eacaa48-89b4-4a3f-a3c4-3346493c02f6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.590464] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.590464] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.590464] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.590642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.590674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.590952] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 1104.617269] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.617459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.617539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.617806] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.618031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.626236] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 1105.062139] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.062328] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.062462] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.062760] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.062920] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.063228] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.063393] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.063516] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.063796] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.063943] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.064249] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.064411] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.064534] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.064845] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.065014] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.065170] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 8eacaa48-89b4-4a3f-a3c4-3346493c02f6 is going to be updated. [ 1105.086987] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.087262] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.087360] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.087656] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.087860] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.088110] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.708172] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 1105.708431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.708565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.708770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.708961] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.709089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.709154] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.709307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.709389] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.709474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.709564] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.764087] env[69692]: INFO networking_nsxv3.common.synchronization [req-e9afaa79-53f5-4120-8290-c15ca7e99769 req-bce8c67f-4a46-4a15-9c07-2df6dd65f683 service nova] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_rules [ 1105.764312] env[69692]: INFO networking_nsxv3.common.synchronization [req-e9afaa79-53f5-4120-8290-c15ca7e99769 req-bce8c67f-4a46-4a15-9c07-2df6dd65f683 service nova] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 1105.764459] env[69692]: INFO networking_nsxv3.common.synchronization [req-e9afaa79-53f5-4120-8290-c15ca7e99769 req-bce8c67f-4a46-4a15-9c07-2df6dd65f683 service nova] Enqueued Resource ID: 8eacaa48-89b4-4a3f-a3c4-3346493c02f6 with Priority: HIGHEST for action port [ 1105.764713] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_rules [ 1105.764869] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 1105.764970] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eacaa48-89b4-4a3f-a3c4-3346493c02f6 with Priority: HIGHEST for action port [ 1105.765497] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.765629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.765694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.765901] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.765985] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.767190] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.767300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.767369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.767541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.767915] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.767915] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.767915] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.768105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.768105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.768169] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.768892] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.769145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.769145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.769327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.769327] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eacaa48-89b4-4a3f-a3c4-3346493c02f6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.211763] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.212028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.212127] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.212429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.212712] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.212809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.212809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.212971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.213071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.213161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.213313] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.213450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.213518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.213606] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.213807] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.213903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.213964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.214122] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.214200] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.214283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.214375] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.271397] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.272403] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.272516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.272669] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8eacaa48-89b4-4a3f-a3c4-3346493c02f6 with status ACTIVE [ 1106.272858] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.272979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.273059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.273278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.273370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.273548] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.273701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.273802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.273916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.273995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.274612] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.274782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.274847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.275068] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.275155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.275243] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8eacaa48-89b4-4a3f-a3c4-3346493c02f6 is going to be updated. [ 1106.293841] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.293991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.294047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.294185] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.294314] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.294519] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8eacaa48-89b4-4a3f-a3c4-3346493c02f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.635016] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1106.635272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.676372] env[69692]: INFO networking_nsxv3.common.synchronization [None req-9115f127-ca3a-459d-8f96-89f4e778c51b tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 with Priority: HIGHEST for action security_group_rules [ 1106.676493] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 with Priority: HIGHEST for action security_group_rules [ 1106.676826] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cdd9a71-efff-486a-bba8-192e985b48d0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.676953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.677030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.677290] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.677357] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cdd9a71-efff-486a-bba8-192e985b48d0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.716540] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcbeb6f9-c515-4ff5-9c1f-1b944526d767: rpc.has_security_group_logging(os_id): False [ 1106.733416] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.733573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.733613] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.733931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.734050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.734243] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.734345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.734412] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.734570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.734772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.735040] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.735155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.735223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.735387] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.735499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.735848] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.735957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.736031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.736187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.736268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.736358] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 1106.777662] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.793060] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.793312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.793394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.793733] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.793797] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.811497] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 1106.813147] env[69692]: INFO networking_nsxv3.common.synchronization [None req-70c28e14-774d-4ddf-b804-d22a5fe6e902 tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 with Priority: HIGHEST for action security_group_rules [ 1106.813384] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 with Priority: HIGHEST for action security_group_rules [ 1106.813909] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cdd9a71-efff-486a-bba8-192e985b48d0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.814033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.209319] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.209603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.209603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.209734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.209824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.210061] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 already deleted. [ 1107.210061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.210177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.210293] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.210380] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cdd9a71-efff-486a-bba8-192e985b48d0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.281249] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.281249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.281541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.281541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.281634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.281766] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 1107.313760] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.313902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.313902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.314544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.314544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.324048] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 1107.729447] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.729905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.729905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.729905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.730106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.730106] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 already deleted. [ 1107.730200] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.830591] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 1108.830591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.334114] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 1109.334114] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.334114] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.334114] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.335165] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.335165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.335165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.335165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.335165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.335165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.335165] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.838037] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.838466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.838466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.838466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.838573] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.838667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.838733] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.838903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.839021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.839119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.839281] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.839368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.839444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.839593] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.839733] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.839874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.839920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.840090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.840304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.840304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.840405] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.343557] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0602c86f-34c6-42e5-a101-35f6c95de05b: rpc.has_security_group_logging(os_id): False [ 1110.363879] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.364173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.364234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.364476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.364591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.364931] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.365196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.365318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.365779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.365779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.365779] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.365934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.365934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.366101] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.366183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.366381] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.366477] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.366542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.366726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.366818] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.366905] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 1110.422717] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.422717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.422717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.422999] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.422999] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.434283] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 1111.814519] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1111.814868] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1112.448505] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 1112.448788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.182162] env[69692]: INFO networking_nsxv3.common.synchronization [req-d775c72e-4fe6-40bf-a4a7-3b5068545603 req-33830f56-f20e-4099-8bc6-50f865cb1794 tempest-ServerDiskConfigTestJSON-756528476 tempest-ServerDiskConfigTestJSON-756528476-project-member] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1113.182749] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGHEST for action security_group_members [ 1113.184469] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.185603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.185603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.185603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.185603] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.185603] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.185917] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.185917] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.186087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.186087] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.688467] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.688685] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.688685] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.688994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.689197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.689434] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.689587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.690308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.690308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.690308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.690308] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be updated. [ 1113.746056] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.746283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.746283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.746495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.746640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.756809] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: IN_PROGRESS for 2s [ 1113.979370] env[69692]: INFO networking_nsxv3.common.synchronization [req-22aee768-9314-4015-aed9-b8cb48f15c3f req-45c25f88-f6c0-4ac3-8064-5158087ddb97 tempest-DeleteServersTestJSON-207338121 tempest-DeleteServersTestJSON-207338121-project-member] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1113.981698] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1113.981698] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.981698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.981698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.981698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.981698] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.981698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.981698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.981698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.981698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.981698] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.226472] env[69692]: INFO networking_nsxv3.common.synchronization [req-3cdb517e-31fc-400b-9640-aa467f04e105 req-dc4a3245-dd9f-4fb5-97fb-07a72f2b1e66 tempest-ServerActionsTestJSON-532161054 tempest-ServerActionsTestJSON-532161054-project-member] Enqueued Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGHEST for action security_group_members [ 1114.227352] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGHEST for action security_group_members [ 1114.227821] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-994aca44-3363-4f2f-9033-f0c0f6791222 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.228382] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.228509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.228803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.229070] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.229237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.229342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.229584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.229804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.229892] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.325977] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.326249] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.326475] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.326885] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.327365] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.327634] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.327847] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.328212] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.328425] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.328714] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.328908] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.329119] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.329328] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.329539] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1114.329740] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.329976] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.349805] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.349983] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1114.350146] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.350326] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-792" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.350636] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-20005b70-2996-4ba6-a22b-e5c8c311749c taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.350814] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-20005b70-2996-4ba6-a22b-e5c8c311749c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.350971] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-20005b70-2996-4ba6-a22b-e5c8c311749c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.351311] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-20005b70-2996-4ba6-a22b-e5c8c311749c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.351455] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20005b70-2996-4ba6-a22b-e5c8c311749c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.454580] env[69692]: INFO networking_nsxv3.common.synchronization [req-8d058e95-5259-4d70-b3ff-b8fafe3e2b35 req-b65d10e7-56f9-4235-a4cc-14a01208c8db tempest-ImagesTestJSON-510458365 tempest-ImagesTestJSON-510458365-project-member] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1114.455149] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1114.455453] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.457953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.457953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.457953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.457953] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.457953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.457953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.457953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.457953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.457953] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.485290] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.485586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.485586] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.485761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.485791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.485981] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.486108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.487810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.487810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.487810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.487810] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1114.512931] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.513105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.513179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.513413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.513575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.522610] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1114.735283] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.735283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.735283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.735283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.735283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.735283] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.735283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.735283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.735283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.735283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.735283] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 994aca44-3363-4f2f-9033-f0c0f6791222 is going to be updated. [ 1114.760645] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.760895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.761048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.761386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.761597] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.772280] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 994aca44-3363-4f2f-9033-f0c0f6791222 in Status: IN_PROGRESS for 2s [ 1114.855518] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.855882] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.855998] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.856765] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.856765] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.856765] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 20005b70-2996-4ba6-a22b-e5c8c311749c not found, creating... [ 1114.856928] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.857054] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.857202] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.857459] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.857614] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.858206] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.858206] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.858349] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.859024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.859024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.859024] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 20005b70-2996-4ba6-a22b-e5c8c311749c is going to be created. [ 1114.877246] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.877477] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.877613] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.877925] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.878185] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.878430] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-20005b70-2996-4ba6-a22b-e5c8c311749c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.959563] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.959751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.959889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.960667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.960667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.960667] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.960667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.960667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.960975] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.960975] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.961207] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 1114.988087] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.988260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.988332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.988539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.988679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.003728] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 1115.625275] env[69692]: INFO networking_nsxv3.common.synchronization [req-22aee768-9314-4015-aed9-b8cb48f15c3f req-f5cc09cc-c825-4a7e-8a2e-6c28d89c54c9 service nova] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_rules [ 1115.625532] env[69692]: INFO networking_nsxv3.common.synchronization [req-22aee768-9314-4015-aed9-b8cb48f15c3f req-f5cc09cc-c825-4a7e-8a2e-6c28d89c54c9 service nova] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1115.625715] env[69692]: INFO networking_nsxv3.common.synchronization [req-22aee768-9314-4015-aed9-b8cb48f15c3f req-f5cc09cc-c825-4a7e-8a2e-6c28d89c54c9 service nova] Enqueued Resource ID: 20005b70-2996-4ba6-a22b-e5c8c311749c with Priority: HIGHEST for action port [ 1115.626657] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_rules [ 1115.626657] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1115.626869] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20005b70-2996-4ba6-a22b-e5c8c311749c with Priority: HIGHEST for action port [ 1115.627022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.627160] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.627230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.627453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.627536] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.628451] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.628557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.629607] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-20005b70-2996-4ba6-a22b-e5c8c311749c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.629607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20005b70-2996-4ba6-a22b-e5c8c311749c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.629607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20005b70-2996-4ba6-a22b-e5c8c311749c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.629607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20005b70-2996-4ba6-a22b-e5c8c311749c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.629607] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20005b70-2996-4ba6-a22b-e5c8c311749c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.768984] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 in Status: SUCCESS [ 1115.769296] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 deletion is rescheduled due to dependency. [ 1115.769442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.131518] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20005b70-2996-4ba6-a22b-e5c8c311749c with status ACTIVE [ 1116.131824] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.132043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.132080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.132635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.132635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.132635] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.132859] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.132859] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.132981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.133055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.133262] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.133358] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.133424] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.133575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.133674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.133821] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20005b70-2996-4ba6-a22b-e5c8c311749c is going to be updated. [ 1116.134994] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.135106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.153256] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.153413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.153471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.153698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.153864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.154060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20005b70-2996-4ba6-a22b-e5c8c311749c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.378604] env[69692]: INFO networking_nsxv3.common.synchronization [req-2c4346f4-ead0-4d6f-87b8-2da176325b51 req-907c1beb-5217-4e52-acae-e5d44b1e2665 tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 with Priority: HIGHEST for action security_group_members [ 1116.378965] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 with Priority: HIGHEST for action security_group_members [ 1116.379286] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cdd9a71-efff-486a-bba8-192e985b48d0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.379409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.379476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.379736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.379975] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.380102] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.380171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.380333] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.380420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.380513] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cdd9a71-efff-486a-bba8-192e985b48d0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.533130] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1116.533325] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 deletion is rescheduled due to dependency. [ 1116.533443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.535113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.535113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.535113] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.535113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.535113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.535113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.535113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.535113] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.710607] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-630 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.710899] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.710982] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.711285] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.711583] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.711786] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.712156] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.712403] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.712544] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.712754] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.712872] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.712979] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.713096] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.713202] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.713305] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.713440] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.733160] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.733332] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1116.733472] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.733644] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.733981] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-eb2304e4-7e23-4ad0-8695-2ed0f54748ee taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.734901] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-eb2304e4-7e23-4ad0-8695-2ed0f54748ee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.734901] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-eb2304e4-7e23-4ad0-8695-2ed0f54748ee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.735138] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-eb2304e4-7e23-4ad0-8695-2ed0f54748ee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.735284] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb2304e4-7e23-4ad0-8695-2ed0f54748ee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.781865] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 994aca44-3363-4f2f-9033-f0c0f6791222 in Status: SUCCESS [ 1116.781865] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 994aca44-3363-4f2f-9033-f0c0f6791222 deletion is rescheduled due to dependency. [ 1116.781865] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.886195] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.886376] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.886442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.886611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.886704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.886969] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.887106] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.887165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.887319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.887394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.887483] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 already deleted. [ 1116.887565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.014339] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1117.014576] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e deletion is rescheduled due to dependency. [ 1117.014732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.036512] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.238068] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.238408] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.238577] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.238906] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.239111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.239311] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port eb2304e4-7e23-4ad0-8695-2ed0f54748ee not found, creating... [ 1117.239632] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.239833] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.239968] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.240221] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.240363] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.240646] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.240804] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.240950] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.241241] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.241418] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.241590] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: eb2304e4-7e23-4ad0-8695-2ed0f54748ee is going to be created. [ 1117.262041] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.262041] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.262041] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.262041] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.262275] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.262356] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-eb2304e4-7e23-4ad0-8695-2ed0f54748ee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.538795] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.043552] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.043988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.043988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.044073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.044131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.044231] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1118.077530] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.077688] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.077749] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.077937] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.078100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.088133] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1118.236337] env[69692]: INFO networking_nsxv3.common.synchronization [req-2c4346f4-ead0-4d6f-87b8-2da176325b51 req-d4e43042-a7c2-4f12-bd92-ed91eb350fe4 service nova] Enqueued Resource ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 with Priority: HIGHEST for action security_group_rules [ 1118.236564] env[69692]: INFO networking_nsxv3.common.synchronization [req-2c4346f4-ead0-4d6f-87b8-2da176325b51 req-d4e43042-a7c2-4f12-bd92-ed91eb350fe4 service nova] Enqueued Resource ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 with Priority: HIGHEST for action security_group_members [ 1118.236707] env[69692]: INFO networking_nsxv3.common.synchronization [req-2c4346f4-ead0-4d6f-87b8-2da176325b51 req-d4e43042-a7c2-4f12-bd92-ed91eb350fe4 service nova] Enqueued Resource ID: eb2304e4-7e23-4ad0-8695-2ed0f54748ee with Priority: HIGHEST for action port [ 1118.237244] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 with Priority: HIGHEST for action security_group_rules [ 1118.237379] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 with Priority: HIGHEST for action security_group_members [ 1118.237516] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb2304e4-7e23-4ad0-8695-2ed0f54748ee with Priority: HIGHEST for action port [ 1118.237755] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cdd9a71-efff-486a-bba8-192e985b48d0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.238421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.238499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.238816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.239351] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cdd9a71-efff-486a-bba8-192e985b48d0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.240284] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cdd9a71-efff-486a-bba8-192e985b48d0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.240441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.240534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.240752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.240942] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.241058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.241123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.241275] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.241401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.241517] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cdd9a71-efff-486a-bba8-192e985b48d0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.242383] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb2304e4-7e23-4ad0-8695-2ed0f54748ee taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.242521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb2304e4-7e23-4ad0-8695-2ed0f54748ee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.242608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb2304e4-7e23-4ad0-8695-2ed0f54748ee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.242788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb2304e4-7e23-4ad0-8695-2ed0f54748ee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.242889] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb2304e4-7e23-4ad0-8695-2ed0f54748ee',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.712533] env[69692]: INFO networking_nsxv3.common.synchronization [req-cdf92886-b7a8-4dd5-8ab0-144a82d0d9dc req-683c2baf-d344-4769-b116-73d1863c39c2 tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1118.712961] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1118.713521] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.713521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.713521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.713690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.713852] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.713936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.714013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.714162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.714248] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.714340] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.744658] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cdd9a71-efff-486a-bba8-192e985b48d0 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.744771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.744957] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cdd9a71-efff-486a-bba8-192e985b48d0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.745941] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb2304e4-7e23-4ad0-8695-2ed0f54748ee with status ACTIVE [ 1118.745941] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.746046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.746046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.746273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.746311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.746468] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.746564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.746628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.746790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.746846] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.747037] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.747164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.747193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.747321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.747394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.747476] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb2304e4-7e23-4ad0-8695-2ed0f54748ee is going to be updated. [ 1118.771600] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.771600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.771600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.771600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.771600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.771600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb2304e4-7e23-4ad0-8695-2ed0f54748ee" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.046557] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.046557] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.046557] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.046910] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.047144] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.047332] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.047476] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.047726] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.047884] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.048145] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1119.048272] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1119.048384] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1119.048513] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1119.048630] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1119.048737] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1119.048875] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1119.066774] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1119.066923] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1119.067085] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1119.067248] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.067532] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-21e0c140-a61e-4d05-9a9b-e432a558e0e0 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.067697] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-21e0c140-a61e-4d05-9a9b-e432a558e0e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.067818] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-21e0c140-a61e-4d05-9a9b-e432a558e0e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.068214] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-21e0c140-a61e-4d05-9a9b-e432a558e0e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.068366] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e0c140-a61e-4d05-9a9b-e432a558e0e0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.216222] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.249281] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cdd9a71-efff-486a-bba8-192e985b48d0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.570436] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.570675] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.570881] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.571259] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.571426] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.571583] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 21e0c140-a61e-4d05-9a9b-e432a558e0e0 not found, creating... [ 1119.571847] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.572017] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.572143] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.572370] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.572510] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.572793] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.572954] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.573097] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.573302] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.573439] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.573580] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 21e0c140-a61e-4d05-9a9b-e432a558e0e0 is going to be created. [ 1119.595152] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.595377] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.595493] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.595859] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.596010] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.596248] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-21e0c140-a61e-4d05-9a9b-e432a558e0e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.719095] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.751700] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.751972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.752088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.752279] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.752368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.752470] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 is going to be created. [ 1119.775928] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.776024] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.776089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.776371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.776533] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.786336] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 in Status: UNINITIALIZED for 2s [ 1120.097742] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1120.098141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.098141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.098377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.098576] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.098694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.098756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.099011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.099011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.099102] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.099174] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.222353] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.222353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.222353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.222353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.222353] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.222353] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1120.248097] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.248288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.248288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.251283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.251283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.266058] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1120.601605] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.601808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.601856] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.602520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.602520] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.602520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.602520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.602741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.602741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.602741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.603038] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.603038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.603038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.603244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.603428] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.603428] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.603667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.603667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.603667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.604026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.604026] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.903335] env[69692]: INFO networking_nsxv3.common.synchronization [req-cdf92886-b7a8-4dd5-8ab0-144a82d0d9dc req-40ce4fc1-2a1d-4ec4-8038-c5782ce05bda service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 1120.903335] env[69692]: INFO networking_nsxv3.common.synchronization [req-cdf92886-b7a8-4dd5-8ab0-144a82d0d9dc req-40ce4fc1-2a1d-4ec4-8038-c5782ce05bda service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1120.903335] env[69692]: INFO networking_nsxv3.common.synchronization [req-cdf92886-b7a8-4dd5-8ab0-144a82d0d9dc req-40ce4fc1-2a1d-4ec4-8038-c5782ce05bda service nova] Enqueued Resource ID: 21e0c140-a61e-4d05-9a9b-e432a558e0e0 with Priority: HIGHEST for action port [ 1120.903335] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 1120.903335] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1120.903335] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21e0c140-a61e-4d05-9a9b-e432a558e0e0 with Priority: HIGHEST for action port [ 1120.903798] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.904230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.904458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.904744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.905017] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.906084] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.906379] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.906823] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-21e0c140-a61e-4d05-9a9b-e432a558e0e0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.907079] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21e0c140-a61e-4d05-9a9b-e432a558e0e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.907374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21e0c140-a61e-4d05-9a9b-e432a558e0e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.907683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21e0c140-a61e-4d05-9a9b-e432a558e0e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.907852] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e0c140-a61e-4d05-9a9b-e432a558e0e0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.105678] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 532815ef-03c8-40fb-91ab-292fc1c769b2: rpc.has_security_group_logging(os_id): False [ 1121.120165] env[69692]: INFO networking_nsxv3.common.synchronization [req-a0f2f62e-51ca-4d81-9594-de3620bf04be req-3bba9223-4af2-46c9-a775-afb411deadf1 tempest-ImagesOneServerNegativeTestJSON-1823576721 tempest-ImagesOneServerNegativeTestJSON-1823576721-project-member] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1121.120165] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1121.120165] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.120165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.120165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.120165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.120165] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.120165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.120165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.120165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.120165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.121021] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.131465] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.131465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.131465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.131465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.131465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.131465] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.131465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.131465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.131465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.131465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.131465] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.131465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.131465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.131465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.131465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.132033] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.132033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.132033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.132033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.132033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.132033] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1121.208100] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.208100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.208100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.208100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.208100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.231681] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1121.412853] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.412853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.412853] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21e0c140-a61e-4d05-9a9b-e432a558e0e0 with status ACTIVE [ 1121.412853] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.412853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.412853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.412853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.412853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.412853] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.412853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.412853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.412853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.412853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.412853] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.413630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.413630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.413630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.413630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.413630] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21e0c140-a61e-4d05-9a9b-e432a558e0e0 is going to be updated. [ 1121.431876] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.431876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.431876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.431876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.431876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.431876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21e0c140-a61e-4d05-9a9b-e432a558e0e0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.440249] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.442019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-815" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.442019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-815" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.442019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-815" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.442019] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.442019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.445978] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.445978] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.445978] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.445978] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.445978] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.445978] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.445978] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.445978] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1121.445978] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.445978] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.469044] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.469044] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1121.469044] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.469044] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-815" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.469044] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-7c0d5279-0093-41e7-81c8-3e4a65ac053e taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.469044] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-7c0d5279-0093-41e7-81c8-3e4a65ac053e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.469044] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-7c0d5279-0093-41e7-81c8-3e4a65ac053e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.469044] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-7c0d5279-0093-41e7-81c8-3e4a65ac053e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.469044] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c0d5279-0093-41e7-81c8-3e4a65ac053e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.624552] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.624552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.624552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.624764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.624839] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.625090] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.625220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.625309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.625466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.625646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.625646] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 is going to be updated. [ 1121.652687] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.652816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.652928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.653241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.653480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.661681] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: IN_PROGRESS for 2s [ 1121.795910] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 in Status: SUCCESS [ 1121.796205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.796369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.796591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.796787] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.796903] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.796970] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.797166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.797249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.797338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.797428] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6cdd9a71-efff-486a-bba8-192e985b48d0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.971898] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.972168] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.972303] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.972583] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.972737] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.972896] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 7c0d5279-0093-41e7-81c8-3e4a65ac053e not found, creating... [ 1121.973177] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.973337] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.973457] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.973684] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.973825] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.974312] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.974499] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.974628] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.974883] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.975060] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.975208] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 7c0d5279-0093-41e7-81c8-3e4a65ac053e is going to be created. [ 1121.996443] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.996647] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.996773] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.997058] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.997295] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.997687] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-7c0d5279-0093-41e7-81c8-3e4a65ac053e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.274975] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1122.275311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.275482] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.275715] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.275904] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.276045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.276115] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.276287] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.276368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.276471] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.300053] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6cdd9a71-efff-486a-bba8-192e985b48d0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.651496] env[69692]: INFO networking_nsxv3.common.synchronization [req-dc319dff-4046-412e-9596-5959eb019a1a req-2c08f7f5-fd69-4809-843c-3367f309b708 tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_members [ 1122.652564] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_members [ 1122.653412] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef6eb63-26a4-4ff5-9105-ba8720b0e581 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.653412] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.653412] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.653648] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.653886] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.653966] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.654018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.654188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.654402] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.654448] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.742809] env[69692]: INFO networking_nsxv3.common.synchronization [req-a0f2f62e-51ca-4d81-9594-de3620bf04be req-ea848011-2abc-4571-a1a4-5131d28bb4bb service nova] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_rules [ 1122.742987] env[69692]: INFO networking_nsxv3.common.synchronization [req-a0f2f62e-51ca-4d81-9594-de3620bf04be req-ea848011-2abc-4571-a1a4-5131d28bb4bb service nova] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1122.743136] env[69692]: INFO networking_nsxv3.common.synchronization [req-a0f2f62e-51ca-4d81-9594-de3620bf04be req-ea848011-2abc-4571-a1a4-5131d28bb4bb service nova] Enqueued Resource ID: 7c0d5279-0093-41e7-81c8-3e4a65ac053e with Priority: HIGHEST for action port [ 1122.743364] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_rules [ 1122.743529] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1122.743579] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c0d5279-0093-41e7-81c8-3e4a65ac053e with Priority: HIGHEST for action port [ 1122.745947] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.746418] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.746499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.746708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.746788] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.747766] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.747834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.748063] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c0d5279-0093-41e7-81c8-3e4a65ac053e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.748161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c0d5279-0093-41e7-81c8-3e4a65ac053e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.748224] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c0d5279-0093-41e7-81c8-3e4a65ac053e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.748397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c0d5279-0093-41e7-81c8-3e4a65ac053e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.748472] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c0d5279-0093-41e7-81c8-3e4a65ac053e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.778649] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.802256] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6cdd9a71-efff-486a-bba8-192e985b48d0: rpc.has_security_group_logging(os_id): False [ 1122.820063] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.820242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.820313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.820540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.820649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.820972] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.821088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.821088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.821270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.821328] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.821436] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 is going to be created. [ 1122.914540] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.915199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.915551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.915807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.916025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.944554] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 in Status: IN_PROGRESS for 2s [ 1123.160203] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.249432] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1123.249671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.253581] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c0d5279-0093-41e7-81c8-3e4a65ac053e with status ACTIVE [ 1123.253799] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.253944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.254033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.254234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.254655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.254868] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.254977] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.255064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.255225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.255304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.255484] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.255570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.255624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.255773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.255839] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.255917] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c0d5279-0093-41e7-81c8-3e4a65ac053e is going to be updated. [ 1123.257130] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.257223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.279378] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.279378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.279378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.279378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.279378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.279378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c0d5279-0093-41e7-81c8-3e4a65ac053e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.280156] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.620079] env[69692]: INFO networking_nsxv3.common.synchronization [req-6c69cd54-55e1-4228-9a2a-c3e2ef5b4677 req-98f803d4-f10d-4fb3-a414-b31f8eea4847 tempest-ImagesTestJSON-510458365 tempest-ImagesTestJSON-510458365-project-member] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1123.620079] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1123.620585] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.621075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.621372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.622920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.622920] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.622920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.622920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.622920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.622920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.622920] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.665540] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.678301] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: SUCCESS [ 1123.678498] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 deletion is rescheduled due to dependency. [ 1123.678629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.679091] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.679311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.679491] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.679624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.679708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.679886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.679969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.683208] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.782693] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.782693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.782856] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.784026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.784026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.784026] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1123.828016] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.828016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.828016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.828016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.828016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.836204] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1124.125893] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.126301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.126301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.126416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.126416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.126616] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.126707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.126756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.126906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.127034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.127102] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 1124.156311] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.156483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.156523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.156725] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.156865] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.166630] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.166805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.166805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.167277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.167689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.167689] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 is going to be updated. [ 1124.175692] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 1124.183062] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.210016] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.210016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.210016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.210016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.210016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.223242] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: IN_PROGRESS for 2s [ 1124.230136] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.230136] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.230136] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.230136] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.230136] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.230136] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.230136] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.230136] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.230519] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.230607] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.230746] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1124.230859] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1124.230969] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1124.231097] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.231207] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1124.231348] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.261871] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.262097] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1124.262275] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.262471] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-993" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.263439] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-a6a9ceae-64c3-496b-b489-079305fd97ad taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.263439] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-a6a9ceae-64c3-496b-b489-079305fd97ad" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.263439] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-a6a9ceae-64c3-496b-b489-079305fd97ad" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.263439] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-a6a9ceae-64c3-496b-b489-079305fd97ad" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.263797] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6a9ceae-64c3-496b-b489-079305fd97ad',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.685683] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.768071] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.768392] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.768559] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.768858] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.769040] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.769285] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port a6a9ceae-64c3-496b-b489-079305fd97ad not found, creating... [ 1124.769569] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.769748] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.769875] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.770145] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.770300] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.770680] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.770846] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.770970] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.771241] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.771342] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.771487] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: a6a9ceae-64c3-496b-b489-079305fd97ad is going to be created. [ 1124.799106] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.799329] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.799462] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.799732] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.799971] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.800231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-a6a9ceae-64c3-496b-b489-079305fd97ad" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.963442] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 in Status: SUCCESS [ 1124.963442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.189968] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.190120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.190120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.190831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.190831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.190831] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 is going to be updated. [ 1125.226805] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.226805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.226805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.226805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.226805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.235861] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: IN_PROGRESS for 2s [ 1125.634874] env[69692]: INFO networking_nsxv3.common.synchronization [req-6c69cd54-55e1-4228-9a2a-c3e2ef5b4677 req-4a0877cd-6691-48fc-a2da-13e501e66a5e service nova] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_rules [ 1125.634874] env[69692]: INFO networking_nsxv3.common.synchronization [req-6c69cd54-55e1-4228-9a2a-c3e2ef5b4677 req-4a0877cd-6691-48fc-a2da-13e501e66a5e service nova] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1125.634874] env[69692]: INFO networking_nsxv3.common.synchronization [req-6c69cd54-55e1-4228-9a2a-c3e2ef5b4677 req-4a0877cd-6691-48fc-a2da-13e501e66a5e service nova] Enqueued Resource ID: a6a9ceae-64c3-496b-b489-079305fd97ad with Priority: HIGHEST for action port [ 1125.634874] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_rules [ 1125.634874] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1125.634874] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6a9ceae-64c3-496b-b489-079305fd97ad with Priority: HIGHEST for action port [ 1125.634874] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.634874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.638539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.638539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.638539] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.638539] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.638539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.638539] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6a9ceae-64c3-496b-b489-079305fd97ad taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.638539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6a9ceae-64c3-496b-b489-079305fd97ad" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.638539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6a9ceae-64c3-496b-b489-079305fd97ad" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.638539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6a9ceae-64c3-496b-b489-079305fd97ad" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.638539] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6a9ceae-64c3-496b-b489-079305fd97ad',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.845884] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1125.846275] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.846427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.846692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.847112] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.847289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.847390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.847632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.848200] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.848200] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.848200] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.139712] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6a9ceae-64c3-496b-b489-079305fd97ad with status ACTIVE [ 1126.140225] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.140444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.140545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.140882] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.141043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.141348] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.141529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.141629] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.141831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.141960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.142224] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.142339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.142415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.142590] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.142671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.142757] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6a9ceae-64c3-496b-b489-079305fd97ad is going to be updated. [ 1126.144126] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.144253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.175365] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.175365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.175365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.175766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.176060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.176318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6a9ceae-64c3-496b-b489-079305fd97ad" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.186615] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1126.186793] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e deletion is rescheduled due to dependency. [ 1126.187248] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.187248] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.187505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.187698] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.188601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.188601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.188601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.188601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.188601] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.233974] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: SUCCESS [ 1126.234272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.354727] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.354727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.354727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.354727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.354727] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.354727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.354727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.354727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.354727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.355286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.355286] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.355286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.355286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.355286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.355433] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.355474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.355605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.355689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.355723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.355799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.355885] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.690649] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.857958] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eab15f99-d56d-4017-8640-5d7acb890c08: rpc.has_security_group_logging(os_id): False [ 1126.875283] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.875440] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.875495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.875703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.875810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.876041] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.876138] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.876199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.876518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.876655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.876789] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.876883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.876944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.877098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.877161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.877359] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.877452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.877512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.877754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.877800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.877919] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1126.940956] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.941119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.941166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.941338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.941477] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.963140] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1127.192853] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.247879] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: SUCCESS [ 1127.247879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.247879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.247879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.247879] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.247879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.247879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.247879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.247879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.247879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.247879] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.698881] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.699175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.699175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.699379] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.699474] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.699576] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 1127.727061] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.727301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.727366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.727540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.727689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.737339] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 1127.750221] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.750495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.750563] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.750752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.751012] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.751214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.751321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.751507] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.751607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.751698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.751931] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.752062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.752113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.752367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.752610] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.752803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.752803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.752938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.753506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.753506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.753506] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.126983] env[69692]: INFO networking_nsxv3.common.synchronization [req-4e89462c-a036-4019-96ce-ce7d19c6e350 req-e5dceb79-6986-42b1-bddf-e0fb28dec513 tempest-AttachVolumeTestJSON-1369618715 tempest-AttachVolumeTestJSON-1369618715-project-member] Enqueued Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGHEST for action security_group_members [ 1128.127734] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGHEST for action security_group_members [ 1128.128020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddea2811-281c-4b6c-b3c2-13049eb000a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.128020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.128020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.128230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.128362] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.128460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.128518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.128660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.128742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.128829] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddea2811-281c-4b6c-b3c2-13049eb000a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.256040] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06b41f20-e9f6-4dd0-84af-8ce8a036eff7: rpc.has_security_group_logging(os_id): False [ 1128.274309] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.274309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.274309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.274494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.278014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.278014] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.278014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.278014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.278014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.278014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.278014] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.278014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.278014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.278014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.278014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.278014] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.278014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.278014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.278557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.278557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.278557] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 is going to be updated. [ 1128.332177] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.332414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.332495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.332766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.332963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.352317] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: IN_PROGRESS for 2s [ 1128.632815] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.633181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.633181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.633697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.634447] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.634447] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.634447] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.634447] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.635589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.635785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.636089] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 is going to be updated. [ 1128.661438] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.661520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.661648] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.661789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.661881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.684646] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 in Status: IN_PROGRESS for 2s [ 1128.979557] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1128.979872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.746916] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1129.747268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.747614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.747945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.748276] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.748478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.748592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.748825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.748982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.749159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.749335] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.252502] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.252502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.252502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.252502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.252502] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.252502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.252875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.252875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.252875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.252875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.253262] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.253262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.253262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.253376] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.253411] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.253503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.254575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.254575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.254575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.254575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.254575] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.369639] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: SUCCESS [ 1130.369809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.694254] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 in Status: SUCCESS [ 1130.694254] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 deletion is rescheduled due to dependency. [ 1130.694254] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.755630] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 480fedb1-b714-4d98-8f62-8eca0ff3855e: rpc.has_security_group_logging(os_id): False [ 1130.771405] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.771591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.771641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.771820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.771913] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.772111] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.772214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.772275] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.772424] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.772623] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.772835] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.772930] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.772992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.773172] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.773285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.773545] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.773693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.773796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.773956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.774062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.774570] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 1130.833013] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.833013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.833013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.833013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.833013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.846286] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 1132.862972] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1132.863368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.128258] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1133.128368] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1133.663112] env[69692]: INFO networking_nsxv3.common.synchronization [req-2c4f7c17-d060-4d43-84dc-3722e37fbed3 req-0bc26314-0525-4d9d-afbd-4c44ac8aa64a tempest-ImagesOneServerNegativeTestJSON-1823576721 tempest-ImagesOneServerNegativeTestJSON-1823576721-project-member] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1133.663395] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGHEST for action security_group_members [ 1133.663738] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.663889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.663961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.666252] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.666421] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.666570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.666640] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.666823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.667670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.667822] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.170821] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.171118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.171118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.171276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.171372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.171571] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.171666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.171740] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.171892] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.171984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.172145] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 is going to be updated. [ 1134.199186] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.199346] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.199420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.199644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.199782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.207657] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: IN_PROGRESS for 2s [ 1136.218380] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 in Status: SUCCESS [ 1136.218621] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 deletion is rescheduled due to dependency. [ 1136.218666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.545113] env[69692]: INFO networking_nsxv3.common.synchronization [req-da03312d-94dc-4f69-bfbb-4f195c22f761 req-ec9e928f-8d85-4576-82ff-7a467a0de1a7 tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1137.545649] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1137.545956] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.546095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.546162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.546359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.546576] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.546653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.546653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.546795] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.546875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.546967] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.999021] env[69692]: INFO networking_nsxv3.common.synchronization [req-8d72af22-427d-4f3b-a246-40143246a081 req-74a150e9-756a-4c10-a9fd-a4b2d67e1c7b tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_members [ 1137.999546] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGHEST for action security_group_members [ 1138.000471] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-bef6eb63-26a4-4ff5-9105-ba8720b0e581 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.000471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.000471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.000471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.000471] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.000841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.000841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.000841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.000973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.001893] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.048349] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.503198] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.503415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.503485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.503702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.503792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.503993] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.504130] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.504196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.504358] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.504439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.504528] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 is going to be updated. [ 1138.531486] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.531630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.531699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.531902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.532056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.541436] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: IN_PROGRESS for 2s [ 1138.550836] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.053320] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.053605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.053760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.054091] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.054293] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.054505] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1139.083533] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.083743] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.083818] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.084141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.084255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.092545] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1140.550322] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 in Status: SUCCESS [ 1140.550682] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 deletion is rescheduled due to dependency. [ 1140.550682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.108063] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1141.108063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.001123] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1143.001410] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1145.600339] env[69692]: INFO networking_nsxv3.common.synchronization [req-092def5c-ccd6-4f75-8654-e198290b69f8 req-df481ea0-0dd8-49a5-b1e9-039353266304 tempest-ImagesTestJSON-510458365 tempest-ImagesTestJSON-510458365-project-member] Enqueued Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1145.600941] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e with Priority: HIGHEST for action security_group_members [ 1145.601313] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-480fedb1-b714-4d98-8f62-8eca0ff3855e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.601425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.601524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.601743] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.601928] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.602670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.602670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.602670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.602670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.602670] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('480fedb1-b714-4d98-8f62-8eca0ff3855e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.104851] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.105084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.105214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.105385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.105480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.105679] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.105774] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.105825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.105976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.106066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.106154] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e is going to be updated. [ 1146.134802] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.134953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.135032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.135271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.135390] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.146940] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: IN_PROGRESS for 2s [ 1148.159046] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e in Status: SUCCESS [ 1148.159344] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 480fedb1-b714-4d98-8f62-8eca0ff3855e deletion is rescheduled due to dependency. [ 1148.159344] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-480fedb1-b714-4d98-8f62-8eca0ff3855e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.316636] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.316997] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.316997] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.317269] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.317528] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.317689] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.317809] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.318050] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.319050] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.319050] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1150.319050] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1150.319050] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1150.319050] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1150.319050] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1150.319382] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1150.319382] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1150.338758] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1150.338932] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1150.339097] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1150.339278] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-781" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.339594] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.339758] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.339877] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.340156] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.340303] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4caa43da-d5ab-4dea-80ae-8a77909ff4eb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.603670] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1150.603670] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1150.757385] env[69692]: INFO networking_nsxv3.common.synchronization [req-344694fc-fb3e-43c1-809e-8c3420ceef6e req-cf74bde7-7b09-47f1-8ee9-16fc97f6951d tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c with Priority: HIGHEST for action security_group_members [ 1150.757977] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c with Priority: HIGHEST for action security_group_members [ 1150.758336] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.758512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.758585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.758783] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.758937] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.759158] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.759313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.759384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.759520] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.760263] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fdc28f1-77ed-4baf-84b4-15276bc8a55c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.789039] env[69692]: INFO networking_nsxv3.common.synchronization [None req-9483fc04-c050-4f7f-b94c-3dec4a540837 tempest-AttachInterfacesTestJSON-494319403 tempest-AttachInterfacesTestJSON-494319403-project-member] Enqueued Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 1150.789484] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0602c86f-34c6-42e5-a101-35f6c95de05b with Priority: HIGHEST for action security_group_members [ 1150.789792] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0602c86f-34c6-42e5-a101-35f6c95de05b taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.789904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.789980] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.790254] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.790417] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.790519] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.790825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.790825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.790825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.791030] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0602c86f-34c6-42e5-a101-35f6c95de05b',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.843635] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.843859] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.843988] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.844303] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.844505] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.844802] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.844996] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.845150] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.845418] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.845594] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.845924] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.846135] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.846290] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.846543] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.846709] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.846891] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 4caa43da-d5ab-4dea-80ae-8a77909ff4eb is going to be updated. [ 1150.871064] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.871292] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.871424] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.871693] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.871894] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.872126] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.261815] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.262336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.265023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.265023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.265023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.265023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.265023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.265023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.265023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.265023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.265023] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c is going to be updated. [ 1151.292154] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.292392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.293333] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.293333] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.293333] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.294080] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.294192] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.294256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.294450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.294536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.294717] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.294807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.294859] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.295009] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.295219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.295340] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b is going to be updated. [ 1151.304016] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c in Status: IN_PROGRESS for 2s [ 1151.317642] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.317908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.317908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.318417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.318565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.326753] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: IN_PROGRESS for 2s [ 1151.679584] env[69692]: INFO networking_nsxv3.common.synchronization [req-28074156-1768-4d0b-8d99-5e2e6ada7fd8 req-d8fb1561-f1af-494c-bfdd-28b773cf129b service nova] Enqueued Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_rules [ 1151.683028] env[69692]: INFO networking_nsxv3.common.synchronization [req-28074156-1768-4d0b-8d99-5e2e6ada7fd8 req-d8fb1561-f1af-494c-bfdd-28b773cf129b service nova] Enqueued Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_members [ 1151.683028] env[69692]: INFO networking_nsxv3.common.synchronization [req-28074156-1768-4d0b-8d99-5e2e6ada7fd8 req-d8fb1561-f1af-494c-bfdd-28b773cf129b service nova] Enqueued Resource ID: 4caa43da-d5ab-4dea-80ae-8a77909ff4eb with Priority: HIGHEST for action port [ 1151.683028] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_rules [ 1151.683028] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_members [ 1151.683028] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4caa43da-d5ab-4dea-80ae-8a77909ff4eb with Priority: HIGHEST for action port [ 1151.683028] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a948ef5d-7e31-413f-8d23-aa989234c539 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.683028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.683028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.683028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.683028] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.684729] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a948ef5d-7e31-413f-8d23-aa989234c539 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.684972] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.685148] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.685448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.685700] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.685915] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.686073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.686314] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.686486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.686722] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.687669] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.687902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.688061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.688317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.688486] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4caa43da-d5ab-4dea-80ae-8a77909ff4eb',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.190916] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.192810] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a948ef5d-7e31-413f-8d23-aa989234c539 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.192810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.196250] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4caa43da-d5ab-4dea-80ae-8a77909ff4eb with status ACTIVE [ 1152.196371] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.196492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.196585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.197035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.197035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.197035] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.197250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.197250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.197337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.197381] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.197544] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.197651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.197730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.197914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.198016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.198095] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4caa43da-d5ab-4dea-80ae-8a77909ff4eb is going to be updated. [ 1152.217314] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.218813] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.218981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.220099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.220099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.220099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4caa43da-d5ab-4dea-80ae-8a77909ff4eb" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.695179] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.197594] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.197720] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.197765] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.197961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.198066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.198180] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a948ef5d-7e31-413f-8d23-aa989234c539 is going to be updated. [ 1153.227733] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.227877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.227948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.228161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.228303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.237180] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a948ef5d-7e31-413f-8d23-aa989234c539 in Status: IN_PROGRESS for 2s [ 1153.315930] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c in Status: SUCCESS [ 1153.315930] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fdc28f1-77ed-4baf-84b4-15276bc8a55c deletion is rescheduled due to dependency. [ 1153.315930] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fdc28f1-77ed-4baf-84b4-15276bc8a55c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.337964] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0602c86f-34c6-42e5-a101-35f6c95de05b in Status: SUCCESS [ 1153.338173] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0602c86f-34c6-42e5-a101-35f6c95de05b deletion is rescheduled due to dependency. [ 1153.338287] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0602c86f-34c6-42e5-a101-35f6c95de05b" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.251027] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a948ef5d-7e31-413f-8d23-aa989234c539 in Status: SUCCESS [ 1155.251027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.251027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.251027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.251027] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.251027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.251027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.251027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.251027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.251027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.251027] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.753298] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.258114] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a948ef5d-7e31-413f-8d23-aa989234c539: rpc.has_security_group_logging(os_id): False [ 1156.276032] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.276032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.276032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.276032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.276032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.276626] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.276934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.277137] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.278023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.278023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.278023] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a948ef5d-7e31-413f-8d23-aa989234c539 is going to be updated. [ 1156.333796] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.334064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.334064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.334222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.334615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.347099] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a948ef5d-7e31-413f-8d23-aa989234c539 in Status: IN_PROGRESS for 2s [ 1156.683229] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1156.683390] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1157.221134] env[69692]: INFO networking_nsxv3.common.synchronization [None req-4a329076-dda5-4dac-9bd3-a494c8ee0874 None None] Enqueued Resource ID: 448493db-6a77-4d0b-a8c1-1c7869b022af with Priority: HIGHEST for action port [ 1157.221601] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 448493db-6a77-4d0b-a8c1-1c7869b022af with Priority: HIGHEST for action port [ 1157.221998] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-448493db-6a77-4d0b-a8c1-1c7869b022af taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.222143] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-448493db-6a77-4d0b-a8c1-1c7869b022af" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.222211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-448493db-6a77-4d0b-a8c1-1c7869b022af" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.222496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-448493db-6a77-4d0b-a8c1-1c7869b022af" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.222582] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('448493db-6a77-4d0b-a8c1-1c7869b022af',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.731554] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 448493db-6a77-4d0b-a8c1-1c7869b022af [ 1157.733457] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.733673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.733769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.734084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.734202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.734332] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:448493db-6a77-4d0b-a8c1-1c7869b022af already deleted. [ 1157.734449] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-448493db-6a77-4d0b-a8c1-1c7869b022af" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.254742] env[69692]: INFO networking_nsxv3.common.synchronization [None req-134d4122-d1c2-4982-8af7-e1a3434bf72d tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGHEST for action security_group_rules [ 1158.257403] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGHEST for action security_group_rules [ 1158.257403] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-110f090f-7c2e-4e86-a35e-37ed29bc880a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.257403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.257403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.257403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.257403] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('110f090f-7c2e-4e86-a35e-37ed29bc880a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.362138] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a948ef5d-7e31-413f-8d23-aa989234c539 in Status: SUCCESS [ 1158.362529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.377990] env[69692]: INFO networking_nsxv3.common.synchronization [None req-bce80cde-d898-4e63-b609-edb8a58463e4 tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGHEST for action security_group_rules [ 1158.379511] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGHEST for action security_group_rules [ 1158.379944] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-110f090f-7c2e-4e86-a35e-37ed29bc880a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.380117] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.785052] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.785052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.785052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.785052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.785052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.785052] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a already deleted. [ 1158.785052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.785052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.785052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.785052] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('110f090f-7c2e-4e86-a35e-37ed29bc880a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.311309] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.311503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.311809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.311809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.312082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.312082] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a already deleted. [ 1159.312213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.376311] env[69692]: INFO networking_nsxv3.common.synchronization [None req-2bfe72c3-8128-4d33-8a57-6731e7058185 None None] Enqueued Resource ID: 8d0f21ed-cdb6-4968-9037-4030900eea13 with Priority: HIGHEST for action port [ 1159.376884] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d0f21ed-cdb6-4968-9037-4030900eea13 with Priority: HIGHEST for action port [ 1159.377252] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d0f21ed-cdb6-4968-9037-4030900eea13 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.377384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d0f21ed-cdb6-4968-9037-4030900eea13" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.377454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d0f21ed-cdb6-4968-9037-4030900eea13" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.377723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d0f21ed-cdb6-4968-9037-4030900eea13" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.381028] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d0f21ed-cdb6-4968-9037-4030900eea13',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.548418] env[69692]: INFO networking_nsxv3.common.synchronization [None req-708c251d-c841-4d52-a05b-71a29ad6360c None None] Enqueued Resource ID: e2eb2413-907d-42af-912e-65414eb938e9 with Priority: HIGHEST for action port [ 1159.548910] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2eb2413-907d-42af-912e-65414eb938e9 with Priority: HIGHEST for action port [ 1159.549537] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2eb2413-907d-42af-912e-65414eb938e9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.549537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2eb2413-907d-42af-912e-65414eb938e9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.549537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2eb2413-907d-42af-912e-65414eb938e9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.550787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2eb2413-907d-42af-912e-65414eb938e9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.550927] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2eb2413-907d-42af-912e-65414eb938e9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.880960] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d0f21ed-cdb6-4968-9037-4030900eea13 [ 1159.880960] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.880960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.880960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.880960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.882342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.882342] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d0f21ed-cdb6-4968-9037-4030900eea13 already deleted. [ 1159.882342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d0f21ed-cdb6-4968-9037-4030900eea13" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.054512] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2eb2413-907d-42af-912e-65414eb938e9 [ 1160.055351] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.055550] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.055643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.056567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.057243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.057736] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2eb2413-907d-42af-912e-65414eb938e9 already deleted. [ 1160.057881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2eb2413-907d-42af-912e-65414eb938e9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.208616] env[69692]: INFO networking_nsxv3.common.synchronization [req-edab411d-a827-4ba1-8fc8-8a1b2e243b82 req-e0152168-8813-425e-b41e-cf57eab79e91 tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1160.209215] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1160.209755] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.209755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.209755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.209925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.210076] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.210176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.210234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.210381] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.210466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.210558] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.385215] env[69692]: INFO networking_nsxv3.common.synchronization [None req-d542925a-d161-46f8-b48b-90ac628e7c7b None None] Enqueued Resource ID: 3036baf3-3969-4083-967b-a60d8b180578 with Priority: HIGHEST for action port [ 1160.385919] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3036baf3-3969-4083-967b-a60d8b180578 with Priority: HIGHEST for action port [ 1160.391946] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-3036baf3-3969-4083-967b-a60d8b180578 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.391946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3036baf3-3969-4083-967b-a60d8b180578" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.391946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3036baf3-3969-4083-967b-a60d8b180578" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.391946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3036baf3-3969-4083-967b-a60d8b180578" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.391946] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3036baf3-3969-4083-967b-a60d8b180578',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.716193] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.716659] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.716856] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.717026] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.717250] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.717501] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.717651] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.717784] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.717974] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.718125] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.718347] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1160.718455] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1160.718564] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1160.718697] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1160.718785] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1160.718888] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1160.719026] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1160.738321] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1160.738321] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1160.738464] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1160.738523] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.738836] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-144e1d52-d04b-472c-849b-e8c09f4a72f3 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.739021] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-144e1d52-d04b-472c-849b-e8c09f4a72f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.739158] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-144e1d52-d04b-472c-849b-e8c09f4a72f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.739474] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-144e1d52-d04b-472c-849b-e8c09f4a72f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.739610] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('144e1d52-d04b-472c-849b-e8c09f4a72f3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.894200] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3036baf3-3969-4083-967b-a60d8b180578 [ 1160.894559] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.894649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.894649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.894873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.894960] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.895053] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3036baf3-3969-4083-967b-a60d8b180578 already deleted. [ 1160.895162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3036baf3-3969-4083-967b-a60d8b180578" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.215508] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.243915] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.243915] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.243915] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.244675] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.245091] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.245159] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 144e1d52-d04b-472c-849b-e8c09f4a72f3 not found, creating... [ 1161.245481] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.245961] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.245961] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.246516] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.246516] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.246679] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.246814] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.246958] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.247232] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.247463] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.247597] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 144e1d52-d04b-472c-849b-e8c09f4a72f3 is going to be created. [ 1161.267038] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.269196] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.269196] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.269196] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.269196] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.269196] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-144e1d52-d04b-472c-849b-e8c09f4a72f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.720731] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.721057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.721057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.721295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.721387] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.721489] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1161.749239] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.749581] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.749671] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.749925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.750425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.759031] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1162.046150] env[69692]: INFO networking_nsxv3.common.synchronization [None req-cc3ea6d9-1bd2-4d0e-96e6-79e9a5f27fc3 None None] Enqueued Resource ID: cc447dea-8ce4-41ab-a2e2-abbc5def5f1c with Priority: HIGHEST for action port [ 1162.046851] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc447dea-8ce4-41ab-a2e2-abbc5def5f1c with Priority: HIGHEST for action port [ 1162.047962] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc447dea-8ce4-41ab-a2e2-abbc5def5f1c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.047962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc447dea-8ce4-41ab-a2e2-abbc5def5f1c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.047962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc447dea-8ce4-41ab-a2e2-abbc5def5f1c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.047962] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc447dea-8ce4-41ab-a2e2-abbc5def5f1c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.047962] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc447dea-8ce4-41ab-a2e2-abbc5def5f1c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.079900] env[69692]: INFO networking_nsxv3.common.synchronization [req-edab411d-a827-4ba1-8fc8-8a1b2e243b82 req-2f1e8fcd-5769-4704-a3e9-8a9c7bf0fe8b service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 1162.079900] env[69692]: INFO networking_nsxv3.common.synchronization [req-edab411d-a827-4ba1-8fc8-8a1b2e243b82 req-2f1e8fcd-5769-4704-a3e9-8a9c7bf0fe8b service nova] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1162.079900] env[69692]: INFO networking_nsxv3.common.synchronization [req-edab411d-a827-4ba1-8fc8-8a1b2e243b82 req-2f1e8fcd-5769-4704-a3e9-8a9c7bf0fe8b service nova] Enqueued Resource ID: 144e1d52-d04b-472c-849b-e8c09f4a72f3 with Priority: HIGHEST for action port [ 1162.080168] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_rules [ 1162.080218] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1162.080454] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 144e1d52-d04b-472c-849b-e8c09f4a72f3 with Priority: HIGHEST for action port [ 1162.080849] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.080968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.081299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.081545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.084040] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.084040] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.084040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.084040] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-144e1d52-d04b-472c-849b-e8c09f4a72f3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.084040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-144e1d52-d04b-472c-849b-e8c09f4a72f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.084040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-144e1d52-d04b-472c-849b-e8c09f4a72f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.084040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-144e1d52-d04b-472c-849b-e8c09f4a72f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.084040] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('144e1d52-d04b-472c-849b-e8c09f4a72f3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.551415] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc447dea-8ce4-41ab-a2e2-abbc5def5f1c [ 1162.551647] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.551798] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.551876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.552470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.552470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.552470] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc447dea-8ce4-41ab-a2e2-abbc5def5f1c already deleted. [ 1162.552470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc447dea-8ce4-41ab-a2e2-abbc5def5f1c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.586168] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.586315] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.587719] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 144e1d52-d04b-472c-849b-e8c09f4a72f3 with status ACTIVE [ 1162.587909] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.588044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.588116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.588407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.588407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.588867] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.588867] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.588956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.589134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.589218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.589415] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.590104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.590309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.590423] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.590508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.590602] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 144e1d52-d04b-472c-849b-e8c09f4a72f3 is going to be updated. [ 1162.613396] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.613555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.613555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.613726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.614662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.614662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-144e1d52-d04b-472c-849b-e8c09f4a72f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.534267] env[69692]: INFO networking_nsxv3.common.synchronization [None req-f423d1a7-e2d2-4eb0-9653-9f72e5df125b None None] Enqueued Resource ID: 58025fa8-9dd0-4e2a-9737-b21a1e77d191 with Priority: HIGHEST for action port [ 1163.534628] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58025fa8-9dd0-4e2a-9737-b21a1e77d191 with Priority: HIGHEST for action port [ 1163.535201] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-58025fa8-9dd0-4e2a-9737-b21a1e77d191 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.536029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58025fa8-9dd0-4e2a-9737-b21a1e77d191" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.536029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58025fa8-9dd0-4e2a-9737-b21a1e77d191" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.536029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58025fa8-9dd0-4e2a-9737-b21a1e77d191" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.536029] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58025fa8-9dd0-4e2a-9737-b21a1e77d191',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.771056] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1163.771307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.771476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.771969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.771969] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.772135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.772135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.772294] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.772632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.772749] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.039067] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58025fa8-9dd0-4e2a-9737-b21a1e77d191 [ 1164.039118] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.039264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.039355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.039622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.039741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.039865] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58025fa8-9dd0-4e2a-9737-b21a1e77d191 already deleted. [ 1164.039975] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58025fa8-9dd0-4e2a-9737-b21a1e77d191" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.275606] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.779426] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.281701] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.281863] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.281956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.282169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.282285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.282401] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1165.308463] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.308615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.308685] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.308894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.309048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.316997] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1166.150396] env[69692]: INFO networking_nsxv3.common.synchronization [req-7c6996e2-9705-40d2-9c8e-5a0246d56e83 req-f0069660-4b07-48c3-b34c-4c1017817518 tempest-DeleteServersTestJSON-207338121 tempest-DeleteServersTestJSON-207338121-project-member] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1166.150685] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGHEST for action security_group_members [ 1166.151154] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.151274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.151374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.151536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.151720] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.151771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.151859] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.151969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.152059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.152230] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.655925] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.655925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.655925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.655925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.655925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.655925] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.656459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.656459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.656459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.656459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.656459] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be updated. [ 1166.682926] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.683327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.683327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.683550] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.683620] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.691812] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: IN_PROGRESS for 2s [ 1167.318399] env[69692]: INFO networking_nsxv3.common.synchronization [None req-45f2e81e-1dbf-464c-ac7c-dc991364a77c None None] Enqueued Resource ID: 9f88db8d-fef8-4bad-9bf5-c7529ee1f9a1 with Priority: HIGHEST for action port [ 1167.318399] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f88db8d-fef8-4bad-9bf5-c7529ee1f9a1 with Priority: HIGHEST for action port [ 1167.318399] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f88db8d-fef8-4bad-9bf5-c7529ee1f9a1 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.318399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f88db8d-fef8-4bad-9bf5-c7529ee1f9a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.318399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f88db8d-fef8-4bad-9bf5-c7529ee1f9a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.318399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f88db8d-fef8-4bad-9bf5-c7529ee1f9a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.318399] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f88db8d-fef8-4bad-9bf5-c7529ee1f9a1',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.329055] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1167.329249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.329403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.329604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.329807] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.329887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.329956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.330152] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.330214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.330288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.330373] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.823938] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f88db8d-fef8-4bad-9bf5-c7529ee1f9a1 [ 1167.823938] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.823938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.824135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.824238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.824321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.824416] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f88db8d-fef8-4bad-9bf5-c7529ee1f9a1 already deleted. [ 1167.824555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f88db8d-fef8-4bad-9bf5-c7529ee1f9a1" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.833714] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.834055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.834055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.834287] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.834544] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.834661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.834707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.834880] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.834968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.835066] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.835217] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.835308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.835367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.835507] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.835681] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.835801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.835864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.836043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.836110] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.836191] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.836281] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.339620] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eab15f99-d56d-4017-8640-5d7acb890c08: rpc.has_security_group_logging(os_id): False [ 1168.356467] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.356647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.356741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.356969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.357068] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.357312] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.357409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.357473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.357624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.357705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.357959] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.358908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.358908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.358908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.358908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.358908] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.358908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.358908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.358908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.359253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.359253] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1168.417455] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.417455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.417455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.417663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.417780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.431886] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1168.703790] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 in Status: SUCCESS [ 1168.703932] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 deletion is rescheduled due to dependency. [ 1168.706361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.991528] env[69692]: INFO networking_nsxv3.common.synchronization [req-9e6da04f-f7b8-4320-ab06-3147d564170b req-bfeb2b3a-b242-44ac-9bfc-af344e80b4d9 tempest-ServerTagsTestJSON-314777534 tempest-ServerTagsTestJSON-314777534-project-member] Enqueued Resource ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 with Priority: HIGHEST for action security_group_members [ 1168.991777] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 with Priority: HIGHEST for action security_group_members [ 1168.991966] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fb331de-c43a-4554-b058-e80ee9a9d039 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.995287] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.995360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.995628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.995773] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.995875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.995937] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.996095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.996176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.996264] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fb331de-c43a-4554-b058-e80ee9a9d039',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.213281] env[69692]: INFO networking_nsxv3.common.synchronization [req-ea3e772a-9e1b-432b-87f9-6791188ee4ba req-1370b90f-c880-42c0-9330-c1686e3fb2af tempest-ServerActionsTestJSON-532161054 tempest-ServerActionsTestJSON-532161054-project-member] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1169.214287] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1169.215056] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.215341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.215508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.215793] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.216197] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.216597] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.216761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.217720] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.217921] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.218130] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.374861] env[69692]: INFO networking_nsxv3.common.synchronization [req-0cd44a80-d86c-4090-8b55-9f912f42051b req-745a393c-8fcb-4225-94aa-f27952c28e65 tempest-ServerActionsTestOtherB-2042336296 tempest-ServerActionsTestOtherB-2042336296-project-member] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1169.375409] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1169.376309] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.376309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.376309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.377063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.377288] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.377444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.377517] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.377692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.377775] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.377868] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.393334] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.393460] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-302" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.393562] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-302" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.393838] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-302" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.394689] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.394689] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.394689] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.394919] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.395102] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.395321] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1169.395438] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.395574] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.395696] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.395812] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1169.395924] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.396074] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.413925] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.414032] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1169.414185] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.414373] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-302" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.414715] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-f150a413-a7c9-474b-8bc0-f8aa79f25c9d taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.414894] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-f150a413-a7c9-474b-8bc0-f8aa79f25c9d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.415025] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-f150a413-a7c9-474b-8bc0-f8aa79f25c9d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.415353] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-f150a413-a7c9-474b-8bc0-f8aa79f25c9d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.415496] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f150a413-a7c9-474b-8bc0-f8aa79f25c9d',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.498484] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.498718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.498718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.499016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.499126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.499324] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.499426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.499589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.499767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.499848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.499936] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 already deleted. [ 1169.500027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.646638] env[69692]: INFO networking_nsxv3.common.synchronization [None req-e563cef1-5cff-4503-97cd-120c8815f2d0 None None] Enqueued Resource ID: 9362e1a8-4be2-467a-b000-0b0dea442dea with Priority: HIGHEST for action port [ 1169.647522] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9362e1a8-4be2-467a-b000-0b0dea442dea with Priority: HIGHEST for action port [ 1169.647878] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-9362e1a8-4be2-467a-b000-0b0dea442dea taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.648103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9362e1a8-4be2-467a-b000-0b0dea442dea" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.648220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9362e1a8-4be2-467a-b000-0b0dea442dea" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.648505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9362e1a8-4be2-467a-b000-0b0dea442dea" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.648618] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9362e1a8-4be2-467a-b000-0b0dea442dea',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.722417] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.722612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.722673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.722911] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.742772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.743015] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.743150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.743198] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.743410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.743496] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.743587] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 is going to be updated. [ 1169.766199] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.767071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.767071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.767071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.767071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.783425] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: IN_PROGRESS for 2s [ 1169.879981] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.883904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.883904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.883904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.883904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.883904] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.883904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.883904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.883904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.883904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.883904] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be updated. [ 1169.905076] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.905237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.905362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.905502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.905733] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.914049] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: IN_PROGRESS for 2s [ 1169.919625] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.919793] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.920022] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.920400] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.920644] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.920889] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port f150a413-a7c9-474b-8bc0-f8aa79f25c9d not found, creating... [ 1169.921343] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.921660] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.921791] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.922246] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.922437] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.922883] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.923243] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.923452] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.923931] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.923966] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.924191] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: f150a413-a7c9-474b-8bc0-f8aa79f25c9d is going to be created. [ 1169.942243] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.942243] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.942243] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.942476] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.942720] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.944517] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-f150a413-a7c9-474b-8bc0-f8aa79f25c9d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.150686] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9362e1a8-4be2-467a-b000-0b0dea442dea [ 1170.152415] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.152415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.152415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.152415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.152415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.152415] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9362e1a8-4be2-467a-b000-0b0dea442dea already deleted. [ 1170.152415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9362e1a8-4be2-467a-b000-0b0dea442dea" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.447769] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1170.448125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.703022] env[69692]: INFO networking_nsxv3.common.synchronization [req-9e6da04f-f7b8-4320-ab06-3147d564170b req-f644ee80-1208-4471-8de6-3d3adf61a29f service nova] Enqueued Resource ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 with Priority: HIGHEST for action security_group_rules [ 1170.703022] env[69692]: INFO networking_nsxv3.common.synchronization [req-9e6da04f-f7b8-4320-ab06-3147d564170b req-f644ee80-1208-4471-8de6-3d3adf61a29f service nova] Enqueued Resource ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 with Priority: HIGHEST for action security_group_members [ 1170.703022] env[69692]: INFO networking_nsxv3.common.synchronization [req-9e6da04f-f7b8-4320-ab06-3147d564170b req-f644ee80-1208-4471-8de6-3d3adf61a29f service nova] Enqueued Resource ID: f150a413-a7c9-474b-8bc0-f8aa79f25c9d with Priority: HIGHEST for action port [ 1170.703022] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 with Priority: HIGHEST for action security_group_rules [ 1170.703022] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 with Priority: HIGHEST for action security_group_members [ 1170.703022] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f150a413-a7c9-474b-8bc0-f8aa79f25c9d with Priority: HIGHEST for action port [ 1170.703022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fb331de-c43a-4554-b058-e80ee9a9d039 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.703022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.703022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.704038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.704282] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fb331de-c43a-4554-b058-e80ee9a9d039',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.706020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fb331de-c43a-4554-b058-e80ee9a9d039 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.706278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.706453] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.707130] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.708690] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.708690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.708690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.708690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.708690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.708690] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fb331de-c43a-4554-b058-e80ee9a9d039',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.709588] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-f150a413-a7c9-474b-8bc0-f8aa79f25c9d taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.709853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f150a413-a7c9-474b-8bc0-f8aa79f25c9d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.710308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f150a413-a7c9-474b-8bc0-f8aa79f25c9d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.711760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f150a413-a7c9-474b-8bc0-f8aa79f25c9d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.711760] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f150a413-a7c9-474b-8bc0-f8aa79f25c9d',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.209289] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fb331de-c43a-4554-b058-e80ee9a9d039 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.209289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.217365] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fb331de-c43a-4554-b058-e80ee9a9d039',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.217365] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f150a413-a7c9-474b-8bc0-f8aa79f25c9d with status ACTIVE [ 1171.217365] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.217365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.217365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.217365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.217365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.217365] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.217365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.217365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.217365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.217365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.217365] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.217365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.217365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.217365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.217955] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.217955] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f150a413-a7c9-474b-8bc0-f8aa79f25c9d is going to be updated. [ 1171.239701] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.239701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.239701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.239701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.241504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.241504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f150a413-a7c9-474b-8bc0-f8aa79f25c9d" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.275849] env[69692]: INFO networking_nsxv3.common.synchronization [req-70762fc3-c08d-4607-8428-240f2543f5f4 req-9e24ee21-447e-4443-bcbe-a81292e3695b tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGHEST for action security_group_members [ 1171.276489] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGHEST for action security_group_members [ 1171.276889] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-110f090f-7c2e-4e86-a35e-37ed29bc880a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.277069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.277169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.277446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.277635] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.277740] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.277805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.277957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.278060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.278179] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('110f090f-7c2e-4e86-a35e-37ed29bc880a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.647477] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.648091] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.648091] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.649042] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.649042] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.649252] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.649292] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.649555] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.649739] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.649990] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.650677] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.650677] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.650677] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.650677] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.651039] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.651039] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.670023] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.670023] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1171.670023] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.670023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-644" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.670023] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-6fc8838f-a669-4de6-a642-988dcc0b7cb7 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.670023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-6fc8838f-a669-4de6-a642-988dcc0b7cb7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.670023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-6fc8838f-a669-4de6-a642-988dcc0b7cb7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.670023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-6fc8838f-a669-4de6-a642-988dcc0b7cb7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.670023] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fc8838f-a669-4de6-a642-988dcc0b7cb7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.722091] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fb331de-c43a-4554-b058-e80ee9a9d039',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.780620] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.780776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.780835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.781062] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.781157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.781340] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.781427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.781493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.781633] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.781709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.781794] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a already deleted. [ 1171.781870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.792724] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: SUCCESS [ 1171.792886] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 deletion is rescheduled due to dependency. [ 1171.792986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.925085] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: SUCCESS [ 1171.925085] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 deletion is rescheduled due to dependency. [ 1171.925085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.172048] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.172357] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.172966] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.172966] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.172966] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.173469] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 6fc8838f-a669-4de6-a642-988dcc0b7cb7 not found, creating... [ 1172.173469] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.173624] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.173676] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.173888] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.174119] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.174428] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.174639] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.174780] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.175071] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.175149] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.175288] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 6fc8838f-a669-4de6-a642-988dcc0b7cb7 is going to be created. [ 1172.193637] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.193846] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.193971] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.194242] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.194504] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.196104] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-6fc8838f-a669-4de6-a642-988dcc0b7cb7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.224852] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.224852] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.224852] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.224852] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.225124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.225124] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 is going to be created. [ 1172.253721] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.253721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.253721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.253920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.254085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.264752] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 in Status: UNINITIALIZED for 2s [ 1172.926246] env[69692]: INFO networking_nsxv3.common.synchronization [req-70762fc3-c08d-4607-8428-240f2543f5f4 req-7119a298-95c7-4d4a-9b6b-86d0a6b9b2bf service nova] Enqueued Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGHEST for action security_group_rules [ 1172.926246] env[69692]: INFO networking_nsxv3.common.synchronization [req-70762fc3-c08d-4607-8428-240f2543f5f4 req-7119a298-95c7-4d4a-9b6b-86d0a6b9b2bf service nova] Enqueued Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGHEST for action security_group_members [ 1172.926246] env[69692]: INFO networking_nsxv3.common.synchronization [req-70762fc3-c08d-4607-8428-240f2543f5f4 req-7119a298-95c7-4d4a-9b6b-86d0a6b9b2bf service nova] Enqueued Resource ID: 6fc8838f-a669-4de6-a642-988dcc0b7cb7 with Priority: HIGHEST for action port [ 1172.927595] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGHEST for action security_group_rules [ 1172.928330] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGHEST for action security_group_members [ 1172.928628] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fc8838f-a669-4de6-a642-988dcc0b7cb7 with Priority: HIGHEST for action port [ 1172.929169] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-110f090f-7c2e-4e86-a35e-37ed29bc880a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.929441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.929620] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.930095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.930455] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('110f090f-7c2e-4e86-a35e-37ed29bc880a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.934891] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-110f090f-7c2e-4e86-a35e-37ed29bc880a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.934891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.934891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.934891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.934891] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.934891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.934891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.934891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.934891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.934891] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('110f090f-7c2e-4e86-a35e-37ed29bc880a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.934891] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fc8838f-a669-4de6-a642-988dcc0b7cb7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.935744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fc8838f-a669-4de6-a642-988dcc0b7cb7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.935744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fc8838f-a669-4de6-a642-988dcc0b7cb7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.935744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fc8838f-a669-4de6-a642-988dcc0b7cb7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.935744] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fc8838f-a669-4de6-a642-988dcc0b7cb7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.439035] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-110f090f-7c2e-4e86-a35e-37ed29bc880a taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.439035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.439035] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('110f090f-7c2e-4e86-a35e-37ed29bc880a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.439627] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fc8838f-a669-4de6-a642-988dcc0b7cb7 with status ACTIVE [ 1173.439825] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.439931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.439997] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.440218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.440306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.440777] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.440777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.440777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.440777] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.441075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.441159] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.441313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.441371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.442188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.442188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.442188] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fc8838f-a669-4de6-a642-988dcc0b7cb7 is going to be updated. [ 1173.461381] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.461547] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.461693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.461782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.461916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.462087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fc8838f-a669-4de6-a642-988dcc0b7cb7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.943569] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('110f090f-7c2e-4e86-a35e-37ed29bc880a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.274874] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 in Status: SUCCESS [ 1174.275183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.275397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.275703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.275943] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.276131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.276216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.276459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.276591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.276698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.276794] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fb331de-c43a-4554-b058-e80ee9a9d039',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.334161] env[69692]: INFO networking_nsxv3.common.synchronization [req-fe2fc781-754a-45a4-8e4e-c24046e509df req-3fb96bb9-b5ae-4cf9-bc11-a0189c7b8d53 tempest-InstanceActionsNegativeTestJSON-677323731 tempest-InstanceActionsNegativeTestJSON-677323731-project-member] Enqueued Resource ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 with Priority: HIGHEST for action security_group_members [ 1174.335139] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 with Priority: HIGHEST for action security_group_members [ 1174.335469] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3fa94e-ad64-4239-ae57-26fdc5531217 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.335596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.335696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.335920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.336085] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.336182] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.336241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.336397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.336476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.336568] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3fa94e-ad64-4239-ae57-26fdc5531217',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.447353] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.447643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.447740] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.447932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.448031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.448134] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a is going to be created. [ 1174.470243] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.470513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.470513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.471142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.471142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.479960] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a in Status: UNINITIALIZED for 2s [ 1174.721061] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-858 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.721061] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-858" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.721061] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-858" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.721407] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-858" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.721522] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.721788] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.721884] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.722131] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.722284] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.722528] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1174.722637] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1174.722731] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1174.722845] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1174.722958] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1174.723088] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1174.723225] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1174.741943] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1174.741943] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1174.741943] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1174.741943] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-858" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.741943] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-c5515329-7c0e-4049-b9fd-3e376fff12f6 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.741943] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-c5515329-7c0e-4049-b9fd-3e376fff12f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.742435] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-c5515329-7c0e-4049-b9fd-3e376fff12f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.742435] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-c5515329-7c0e-4049-b9fd-3e376fff12f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.743847] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5515329-7c0e-4049-b9fd-3e376fff12f6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.786920] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fb331de-c43a-4554-b058-e80ee9a9d039 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.786920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.786920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.787171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.787630] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.787630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.787630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.787630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.787883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.787883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.787956] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fb331de-c43a-4554-b058-e80ee9a9d039 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.788121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.788201] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.788350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.788489] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.788573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.788636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.788771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.788851] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.788932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.789049] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fb331de-c43a-4554-b058-e80ee9a9d039',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.839357] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.839514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.839588] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.839803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.839894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.840104] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.840202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.840263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.840410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.840503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.840565] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 already deleted. [ 1174.840647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.244827] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.245159] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.245202] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.245510] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.245707] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.245854] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port c5515329-7c0e-4049-b9fd-3e376fff12f6 not found, creating... [ 1175.246136] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.246296] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.246426] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.246639] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.246785] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.247103] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.247260] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.247379] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.247591] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.247729] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.247869] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: c5515329-7c0e-4049-b9fd-3e376fff12f6 is going to be created. [ 1175.269781] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.269989] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.270133] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.270439] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.270695] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.271592] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-c5515329-7c0e-4049-b9fd-3e376fff12f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.292999] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fb331de-c43a-4554-b058-e80ee9a9d039: rpc.has_security_group_logging(os_id): False [ 1175.310939] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.310939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.310939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.310939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.310939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.311183] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.311239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.311274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.311425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.311502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.311696] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.311786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.311848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.311983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.312061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.312236] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.312324] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.312374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.312533] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.312612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.312696] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 is going to be created. [ 1175.382094] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.382258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.382329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.382669] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.383655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.393866] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 in Status: IN_PROGRESS for 2s [ 1176.438052] env[69692]: INFO networking_nsxv3.common.synchronization [req-fe2fc781-754a-45a4-8e4e-c24046e509df req-745bfac1-2d50-4f13-a4c5-854f59403b06 service nova] Enqueued Resource ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 with Priority: HIGHEST for action security_group_rules [ 1176.438052] env[69692]: INFO networking_nsxv3.common.synchronization [req-fe2fc781-754a-45a4-8e4e-c24046e509df req-745bfac1-2d50-4f13-a4c5-854f59403b06 service nova] Enqueued Resource ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 with Priority: HIGHEST for action security_group_members [ 1176.438408] env[69692]: INFO networking_nsxv3.common.synchronization [req-fe2fc781-754a-45a4-8e4e-c24046e509df req-745bfac1-2d50-4f13-a4c5-854f59403b06 service nova] Enqueued Resource ID: c5515329-7c0e-4049-b9fd-3e376fff12f6 with Priority: HIGHEST for action port [ 1176.438750] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 with Priority: HIGHEST for action security_group_rules [ 1176.438914] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 with Priority: HIGHEST for action security_group_members [ 1176.439094] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5515329-7c0e-4049-b9fd-3e376fff12f6 with Priority: HIGHEST for action port [ 1176.439656] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e3fa94e-ad64-4239-ae57-26fdc5531217 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.439656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.439656] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.439957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.440097] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e3fa94e-ad64-4239-ae57-26fdc5531217',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.440980] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3fa94e-ad64-4239-ae57-26fdc5531217 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.441161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.441253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.441470] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.441685] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.441780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.443019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.443019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.443019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.443019] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3fa94e-ad64-4239-ae57-26fdc5531217',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.443019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5515329-7c0e-4049-b9fd-3e376fff12f6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.443258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5515329-7c0e-4049-b9fd-3e376fff12f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.443258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5515329-7c0e-4049-b9fd-3e376fff12f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.443622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5515329-7c0e-4049-b9fd-3e376fff12f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.443622] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5515329-7c0e-4049-b9fd-3e376fff12f6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.489869] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a in Status: SUCCESS [ 1176.490145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.490326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.490576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.490798] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.490987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.491088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.491264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.491364] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.491454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.491547] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('110f090f-7c2e-4e86-a35e-37ed29bc880a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.946498] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3fa94e-ad64-4239-ae57-26fdc5531217 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.946684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.946880] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e3fa94e-ad64-4239-ae57-26fdc5531217',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.948058] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5515329-7c0e-4049-b9fd-3e376fff12f6 with status ACTIVE [ 1176.948245] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.948471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.948535] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.948745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.948933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.949132] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.949225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.949286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.949445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.949521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.949695] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.949792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.949836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.949973] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.950080] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.950132] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5515329-7c0e-4049-b9fd-3e376fff12f6 is going to be updated. [ 1176.994391] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('110f090f-7c2e-4e86-a35e-37ed29bc880a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.008215] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.008393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.008463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.008666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.008837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.009057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5515329-7c0e-4049-b9fd-3e376fff12f6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.347330] env[69692]: INFO networking_nsxv3.common.synchronization [req-6413ed7a-4a02-48af-8fe6-80880c8c9568 req-e1999900-8936-4387-9ff3-0a4527c7416d tempest-ServerGroupTestJSON-1448874844 tempest-ServerGroupTestJSON-1448874844-project-member] Enqueued Resource ID: 0437342b-6575-4c08-8d68-72455f1041f3 with Priority: HIGHEST for action security_group_members [ 1177.347958] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0437342b-6575-4c08-8d68-72455f1041f3 with Priority: HIGHEST for action security_group_members [ 1177.348575] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0437342b-6575-4c08-8d68-72455f1041f3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.348575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.348575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.348823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.348883] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.348952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.349009] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.349181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.349230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.349305] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0437342b-6575-4c08-8d68-72455f1041f3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.410670] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 in Status: SUCCESS [ 1177.410905] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.452653] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e3fa94e-ad64-4239-ae57-26fdc5531217',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.496798] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 110f090f-7c2e-4e86-a35e-37ed29bc880a: rpc.has_security_group_logging(os_id): False [ 1177.515938] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.516126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.516208] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.516493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.516534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.516776] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.516945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.516945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.517120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.517197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.517286] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a is going to be created. [ 1177.582423] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.582606] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.582692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.582899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.583130] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.595824] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a in Status: IN_PROGRESS for 2s [ 1177.648081] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-522 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.648306] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-522" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.648442] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-522" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.648775] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-522" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.649168] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.649729] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.649729] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.649729] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.649876] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.650055] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.650178] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.650302] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.650821] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.650963] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.651108] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.651253] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.653951] env[69692]: INFO networking_nsxv3.common.synchronization [req-330a9fd2-659f-455d-8fef-968b5b824423 req-8226ca92-b709-482e-be69-203685981a5a tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1177.654793] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1177.655190] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.655341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.655341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.655490] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.655618] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.655706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.655761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.655919] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.656039] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.656133] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.680027] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.680027] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.680027] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.680200] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-522" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.680425] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-701c355a-edc0-433a-8514-51634a2e7152 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.680601] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-701c355a-edc0-433a-8514-51634a2e7152" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.680724] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-701c355a-edc0-433a-8514-51634a2e7152" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.681227] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-701c355a-edc0-433a-8514-51634a2e7152" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.681380] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('701c355a-edc0-433a-8514-51634a2e7152',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.851664] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.851664] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.851664] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.851840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.851948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.852112] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.852184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.852249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.852398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.852473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.852557] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0437342b-6575-4c08-8d68-72455f1041f3 already deleted. [ 1177.852862] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.954613] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.954807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.954875] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.955112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.955215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.955317] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 is going to be created. [ 1177.977879] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.978092] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.978179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.978393] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.978553] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.987620] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 in Status: UNINITIALIZED for 2s [ 1178.159241] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.184166] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.184400] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.184538] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.185194] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.185194] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.185303] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 701c355a-edc0-433a-8514-51634a2e7152 not found, creating... [ 1178.185561] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.185743] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.185868] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.186109] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.186510] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.186575] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.186684] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.186804] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.187024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.187166] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.187310] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 701c355a-edc0-433a-8514-51634a2e7152 is going to be created. [ 1178.214807] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.214807] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.214807] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.214807] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.214807] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.214807] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-701c355a-edc0-433a-8514-51634a2e7152" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.661731] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.746715] env[69692]: INFO networking_nsxv3.common.synchronization [req-105bc71f-1b3b-4b50-8280-c230d9ad6bd5 req-272b0ce0-b3d2-4a42-8489-287b69c71eba tempest-ServersNegativeTestJSON-162754182 tempest-ServersNegativeTestJSON-162754182-project-member] Enqueued Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1178.746892] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1178.747232] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.747389] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.747438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.747742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.747860] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.747924] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.747979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.748540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.748540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.748540] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.160656] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-206 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.160656] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-206" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.161804] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-206" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.161804] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-206" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.162333] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.162577] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.163806] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.163806] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.163806] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.164128] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.164216] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.164763] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.164763] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.166955] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.166955] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.166955] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.167463] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.167580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.167645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.167811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.167896] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.167982] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1179.191402] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.191402] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1179.191402] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.191402] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-206" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.191402] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.191402] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.191402] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.193530] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.193530] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8451a21e-0abb-4e9a-bb44-1e2fafbd8503',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.200321] env[69692]: INFO networking_nsxv3.common.synchronization [req-6413ed7a-4a02-48af-8fe6-80880c8c9568 req-ed341a45-9dd2-4721-a056-65575a8a3e7d service nova] Enqueued Resource ID: 0437342b-6575-4c08-8d68-72455f1041f3 with Priority: HIGHEST for action security_group_rules [ 1179.200321] env[69692]: INFO networking_nsxv3.common.synchronization [req-6413ed7a-4a02-48af-8fe6-80880c8c9568 req-ed341a45-9dd2-4721-a056-65575a8a3e7d service nova] Enqueued Resource ID: 0437342b-6575-4c08-8d68-72455f1041f3 with Priority: HIGHEST for action security_group_members [ 1179.200321] env[69692]: INFO networking_nsxv3.common.synchronization [req-6413ed7a-4a02-48af-8fe6-80880c8c9568 req-ed341a45-9dd2-4721-a056-65575a8a3e7d service nova] Enqueued Resource ID: 701c355a-edc0-433a-8514-51634a2e7152 with Priority: HIGHEST for action port [ 1179.201532] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0437342b-6575-4c08-8d68-72455f1041f3 with Priority: HIGHEST for action security_group_rules [ 1179.202031] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0437342b-6575-4c08-8d68-72455f1041f3 with Priority: HIGHEST for action security_group_members [ 1179.202979] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 701c355a-edc0-433a-8514-51634a2e7152 with Priority: HIGHEST for action port [ 1179.203961] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0437342b-6575-4c08-8d68-72455f1041f3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.203961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.203961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.203961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.203961] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0437342b-6575-4c08-8d68-72455f1041f3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.205435] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0437342b-6575-4c08-8d68-72455f1041f3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.205604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.207026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.207026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.207026] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.207026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.207026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.207026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.207026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.207026] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0437342b-6575-4c08-8d68-72455f1041f3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.208537] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-701c355a-edc0-433a-8514-51634a2e7152 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.211023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-701c355a-edc0-433a-8514-51634a2e7152" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.211023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-701c355a-edc0-433a-8514-51634a2e7152" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.211023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-701c355a-edc0-433a-8514-51634a2e7152" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.211023] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('701c355a-edc0-433a-8514-51634a2e7152',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.211023] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.211023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.211023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.211499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.211775] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.222767] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1179.252135] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.252135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.252135] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.252404] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.252530] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.252852] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.252969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.253073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.253254] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.253345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.253443] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 already deleted. [ 1179.253524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.612506] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a in Status: SUCCESS [ 1179.612506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.696320] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.696995] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.697307] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.697730] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.698055] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.699575] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 8451a21e-0abb-4e9a-bb44-1e2fafbd8503 not found, creating... [ 1179.699575] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.699575] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.699575] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.699575] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.699575] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.704395] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.704395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.704395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.704395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.704395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.704395] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 8451a21e-0abb-4e9a-bb44-1e2fafbd8503 is going to be created. [ 1179.709405] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0437342b-6575-4c08-8d68-72455f1041f3 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.711132] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.711132] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0437342b-6575-4c08-8d68-72455f1041f3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.715634] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 701c355a-edc0-433a-8514-51634a2e7152 with status ACTIVE [ 1179.715634] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.715634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.715634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.718335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.718335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.718335] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.718335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.718335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.718335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.718335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.718335] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.718335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.718335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.718335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.718335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.718335] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 701c355a-edc0-433a-8514-51634a2e7152 is going to be updated. [ 1179.724093] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.724093] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.724093] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.724093] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.724093] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.724093] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.739469] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.739639] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.739711] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.739910] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.740063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.740216] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-701c355a-edc0-433a-8514-51634a2e7152" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.998595] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 in Status: SUCCESS [ 1179.998929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.999212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.000322] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.000568] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.000706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.000771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.000953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.001070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.001966] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.001966] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e3fa94e-ad64-4239-ae57-26fdc5531217',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.214528] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0437342b-6575-4c08-8d68-72455f1041f3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.504364] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3fa94e-ad64-4239-ae57-26fdc5531217 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.505266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.505427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.506031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.506389] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.508714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.508714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.508714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.508714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.508714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.508714] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3fa94e-ad64-4239-ae57-26fdc5531217 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.508714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.508714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.508714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.508714] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.508714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.508714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.508714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.508714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.508714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.508714] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e3fa94e-ad64-4239-ae57-26fdc5531217',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.575040] env[69692]: INFO networking_nsxv3.common.synchronization [req-105bc71f-1b3b-4b50-8280-c230d9ad6bd5 req-3aa6bd0b-922b-4e14-a5e0-b2df2d0ad973 service nova] Enqueued Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_rules [ 1180.575040] env[69692]: INFO networking_nsxv3.common.synchronization [req-105bc71f-1b3b-4b50-8280-c230d9ad6bd5 req-3aa6bd0b-922b-4e14-a5e0-b2df2d0ad973 service nova] Enqueued Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1180.575040] env[69692]: INFO networking_nsxv3.common.synchronization [req-105bc71f-1b3b-4b50-8280-c230d9ad6bd5 req-3aa6bd0b-922b-4e14-a5e0-b2df2d0ad973 service nova] Enqueued Resource ID: 8451a21e-0abb-4e9a-bb44-1e2fafbd8503 with Priority: HIGHEST for action port [ 1180.575040] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_rules [ 1180.575040] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1180.575411] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8451a21e-0abb-4e9a-bb44-1e2fafbd8503 with Priority: HIGHEST for action port [ 1180.575849] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.576171] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.579026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.579026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.579026] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.579026] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.579026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.579026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.579026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.579026] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.579026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.579026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.579026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.579026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.580090] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.581941] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.581941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.581941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.582508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.583977] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8451a21e-0abb-4e9a-bb44-1e2fafbd8503',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.716719] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.717750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.717750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.717750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.720026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.720026] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0437342b-6575-4c08-8d68-72455f1041f3 is going to be created. [ 1180.740725] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.741254] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.741254] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.742133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.742133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.751653] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0437342b-6575-4c08-8d68-72455f1041f3 in Status: UNINITIALIZED for 2s [ 1181.012463] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e3fa94e-ad64-4239-ae57-26fdc5531217: rpc.has_security_group_logging(os_id): False [ 1181.031560] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.031560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.031560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.031560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.031560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.031560] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.031560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.031560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.031560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.031560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.031560] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.032264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.032264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.032264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.032264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.032264] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.032264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.032714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.032714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.032714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.032836] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 is going to be created. [ 1181.084863] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.086550] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.086550] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.086550] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8451a21e-0abb-4e9a-bb44-1e2fafbd8503 with status ACTIVE [ 1181.086872] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.086872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.086872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.087048] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.087159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.087353] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.087452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.087542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.087674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.087755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.087939] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.088260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.088461] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.088634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.088634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.088824] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8451a21e-0abb-4e9a-bb44-1e2fafbd8503 is going to be updated. [ 1181.091021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.091147] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.091215] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.091378] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.091544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.103634] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 in Status: IN_PROGRESS for 2s [ 1181.111214] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.111398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.111511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.111680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.111819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.111979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.239576] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1181.239871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.595036] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.096529] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.096848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.096848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.097108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.097300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.097425] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 is going to be created. [ 1182.129045] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.129314] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.129421] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.129612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.129787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.141400] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: UNINITIALIZED for 2s [ 1182.207975] env[69692]: INFO networking_nsxv3.common.synchronization [req-de52bb44-3623-4765-9a1b-b2a550aa1c59 req-fcc95482-afc9-451f-b3da-0e67ee707063 tempest-ServerTagsTestJSON-314777534 tempest-ServerTagsTestJSON-314777534-project-member] Enqueued Resource ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 with Priority: HIGHEST for action security_group_members [ 1182.208636] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 with Priority: HIGHEST for action security_group_members [ 1182.209018] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fb331de-c43a-4554-b058-e80ee9a9d039 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.209167] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.209299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.209592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.209782] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.209866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.210233] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.210233] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.210233] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.210361] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fb331de-c43a-4554-b058-e80ee9a9d039',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.712753] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.712995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.713131] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.713562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.713721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.714100] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.714367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.714468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.714736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.714815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.714917] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 is going to be updated. [ 1182.743356] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.743529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.743575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.743789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.743928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.754555] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 in Status: IN_PROGRESS for 2s [ 1182.760291] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0437342b-6575-4c08-8d68-72455f1041f3 in Status: SUCCESS [ 1182.760507] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.760670] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.760893] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.761142] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.761302] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.761302] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.761431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.761508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.761595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.761687] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0437342b-6575-4c08-8d68-72455f1041f3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.119657] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 in Status: SUCCESS [ 1183.119994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.263598] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0437342b-6575-4c08-8d68-72455f1041f3 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.264414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.264414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.264414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.264414] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.264414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.264414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.264757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.264877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.265060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.265255] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0437342b-6575-4c08-8d68-72455f1041f3 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.265379] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.265459] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.265645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.265797] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.265888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.265948] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.266143] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.266401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.266401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.266523] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0437342b-6575-4c08-8d68-72455f1041f3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.768964] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0437342b-6575-4c08-8d68-72455f1041f3: rpc.has_security_group_logging(os_id): False [ 1183.785826] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.785968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.786055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.786261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.786350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.786538] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.786635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.786697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.786858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.786939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.787149] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.787242] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.787303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.787441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.787516] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.787688] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.787780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.787841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.787974] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.788058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.788144] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0437342b-6575-4c08-8d68-72455f1041f3 is going to be created. [ 1183.838440] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.838592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.838654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.838847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.839465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.853792] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0437342b-6575-4c08-8d68-72455f1041f3 in Status: IN_PROGRESS for 2s [ 1184.155161] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: SUCCESS [ 1184.155161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.155161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.155161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.155161] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.155161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.155161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.155161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.155161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.156426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.156426] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.334227] env[69692]: INFO networking_nsxv3.common.synchronization [req-736a9b65-936b-4ba3-82a3-9f76e3921871 req-4528c1ab-ad1b-40b9-b308-ab9661c37f42 tempest-ServerActionsTestOtherB-2042336296 tempest-ServerActionsTestOtherB-2042336296-project-member] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1184.334227] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1184.334227] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.334417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.334417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.334534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.334653] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.334778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.334842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.334946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.335041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.335136] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.449434] env[69692]: INFO networking_nsxv3.common.synchronization [req-51f56493-2099-4ae3-aad9-e3f6ce65cd26 req-22c7d62a-c11f-4790-9f1e-d1b6392ab876 tempest-ServersTestJSON-262762065 tempest-ServersTestJSON-262762065-project-member] Enqueued Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1184.449829] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eab15f99-d56d-4017-8640-5d7acb890c08 with Priority: HIGHEST for action security_group_members [ 1184.451285] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-eab15f99-d56d-4017-8640-5d7acb890c08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.451285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.451285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.451285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.451285] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.451285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.451285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.451285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.451285] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.451285] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eab15f99-d56d-4017-8640-5d7acb890c08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.660400] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.660694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.660694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.660833] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.663029] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.663029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.663029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.663029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.663029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.663029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.663029] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.663029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.663029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.663029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.663029] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.663029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.663029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.663029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.663029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.663029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.663029] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.723311] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-199 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.724023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.724023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.724023] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.724222] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.724403] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.724527] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.724770] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.724946] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.725179] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.725730] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1184.725730] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1184.725730] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1184.725730] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.725730] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1184.725970] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1184.744249] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1184.745387] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1184.745387] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1184.745387] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.745387] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-07e722ee-52b4-4ea2-a403-342bdceeb278 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.745387] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.745387] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.745759] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.745882] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07e722ee-52b4-4ea2-a403-342bdceeb278',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.761945] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 in Status: SUCCESS [ 1184.762144] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 deletion is rescheduled due to dependency. [ 1184.762262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.837212] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.837375] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.837448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.837647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.837737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.837934] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.838045] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.838108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.838257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.838334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.838421] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be updated. [ 1184.861837] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.862133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.862133] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.862288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.862351] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.869824] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: IN_PROGRESS for 2s [ 1184.954089] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.954286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.954286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.954465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.954563] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.954802] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.954958] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.955027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.955195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.955270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.955363] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 is going to be updated. [ 1184.980471] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.980616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.980672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.980872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.981018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.990683] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: IN_PROGRESS for 2s [ 1185.167516] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3dc0cc02-0477-4365-b448-c823c1d0ff33: rpc.has_security_group_logging(os_id): False [ 1185.188043] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.188271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.188419] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.188744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.188906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.189278] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.189428] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.189545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.189820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.189971] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.190369] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.190548] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.190665] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.190920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.191078] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.191415] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.191592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.191708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.191957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.192112] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.192248] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 is going to be created. [ 1185.250387] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.250836] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.251019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.251488] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.251680] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.251928] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 07e722ee-52b4-4ea2-a403-342bdceeb278 not found, creating... [ 1185.252496] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.252758] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.253015] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.253452] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.253749] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.254373] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.254695] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.254952] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.255403] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.255711] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.255961] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 07e722ee-52b4-4ea2-a403-342bdceeb278 is going to be created. [ 1185.274666] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.275017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.275143] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.275491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.275829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.278835] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.279150] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.279396] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.279707] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.280171] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.280583] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.288449] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: IN_PROGRESS for 2s [ 1185.867108] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0437342b-6575-4c08-8d68-72455f1041f3 in Status: SUCCESS [ 1185.867386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.270197] env[69692]: INFO networking_nsxv3.common.synchronization [req-736a9b65-936b-4ba3-82a3-9f76e3921871 req-fdffffc8-67f9-41ff-9f13-dc24a86265db service nova] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_rules [ 1186.270197] env[69692]: INFO networking_nsxv3.common.synchronization [req-736a9b65-936b-4ba3-82a3-9f76e3921871 req-fdffffc8-67f9-41ff-9f13-dc24a86265db service nova] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1186.270197] env[69692]: INFO networking_nsxv3.common.synchronization [req-736a9b65-936b-4ba3-82a3-9f76e3921871 req-fdffffc8-67f9-41ff-9f13-dc24a86265db service nova] Enqueued Resource ID: 07e722ee-52b4-4ea2-a403-342bdceeb278 with Priority: HIGHEST for action port [ 1186.271729] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_rules [ 1186.271729] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1186.271729] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e722ee-52b4-4ea2-a403-342bdceeb278 with Priority: HIGHEST for action port [ 1186.271729] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.271729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.271729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.271729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.271729] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.272432] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.273044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.273044] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-07e722ee-52b4-4ea2-a403-342bdceeb278 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.273044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.273044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.273409] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.273409] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07e722ee-52b4-4ea2-a403-342bdceeb278',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.644946] env[69692]: INFO networking_nsxv3.common.synchronization [req-7586e263-e65e-44c6-b7c5-72e9dd280209 req-cabccf8d-ea1f-4c46-b9df-259c3ed675db tempest-ServerActionsTestJSON-532161054 tempest-ServerActionsTestJSON-532161054-project-member] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1186.645166] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1186.645794] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.645794] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.645794] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.646044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.646095] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.646187] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.646263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.646437] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.646524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.646628] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.775774] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.775928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.776153] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07e722ee-52b4-4ea2-a403-342bdceeb278 with status ACTIVE [ 1186.776326] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.776435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.776503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.776719] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.776826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.777082] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.777204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.777204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.777361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.777416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.777563] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.777653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.777708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.777848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.777921] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.778014] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07e722ee-52b4-4ea2-a403-342bdceeb278 is going to be updated. [ 1186.800758] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.800758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.800758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.800758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.800758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.800758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.881130] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: SUCCESS [ 1186.881240] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 deletion is rescheduled due to dependency. [ 1186.881369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.881569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.881810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.882036] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.882200] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.882269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.882464] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.882574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.882694] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.999691] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.000064] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.000239] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.000530] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.000926] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.001127] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.001254] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.001534] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.001714] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.001953] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.002115] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.002258] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.002394] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.002573] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1187.002676] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.002833] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.004601] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eab15f99-d56d-4017-8640-5d7acb890c08 in Status: SUCCESS [ 1187.004850] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eab15f99-d56d-4017-8640-5d7acb890c08 deletion is rescheduled due to dependency. [ 1187.004949] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eab15f99-d56d-4017-8640-5d7acb890c08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.021856] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.021999] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1187.022104] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.022256] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.022599] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-235bb715-0a41-441e-b0d2-c5606ae4a5fd taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.022740] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-235bb715-0a41-441e-b0d2-c5606ae4a5fd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.022865] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-235bb715-0a41-441e-b0d2-c5606ae4a5fd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.023997] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-235bb715-0a41-441e-b0d2-c5606ae4a5fd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.023997] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('235bb715-0a41-441e-b0d2-c5606ae4a5fd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.150033] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.150033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.150033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.150033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.150033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.150033] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.150431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.150431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.150431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.150431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.150568] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 is going to be updated. [ 1187.192328] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.192514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.192514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.192701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.192878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.201618] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: IN_PROGRESS for 2s [ 1187.301071] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: SUCCESS [ 1187.301450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.384480] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.526478] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.526717] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.526860] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.527165] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.527316] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.527474] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 235bb715-0a41-441e-b0d2-c5606ae4a5fd not found, creating... [ 1187.527737] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.527898] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.528030] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.528262] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.528412] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.528691] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.528851] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.528971] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.529198] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.529336] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.529477] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 235bb715-0a41-441e-b0d2-c5606ae4a5fd is going to be created. [ 1187.552349] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.552546] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.552879] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.553264] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.553526] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.553807] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-235bb715-0a41-441e-b0d2-c5606ae4a5fd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.889019] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.146412] env[69692]: INFO networking_nsxv3.common.synchronization [req-d77e5eaa-900e-4bd2-80eb-cce5a96aef4d req-75428a29-4427-4313-8fe9-c4a3c058edce tempest-InstanceActionsNegativeTestJSON-677323731 tempest-InstanceActionsNegativeTestJSON-677323731-project-member] Enqueued Resource ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 with Priority: HIGHEST for action security_group_members [ 1188.146948] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 with Priority: HIGHEST for action security_group_members [ 1188.147366] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e3fa94e-ad64-4239-ae57-26fdc5531217 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.148093] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.148195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.148366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.148532] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.148634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.148701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.148929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.149043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.149109] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e3fa94e-ad64-4239-ae57-26fdc5531217',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.292859] env[69692]: INFO networking_nsxv3.common.synchronization [req-7586e263-e65e-44c6-b7c5-72e9dd280209 req-f0517d1b-6bc8-4d90-b934-a20ed54745c4 service nova] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_rules [ 1188.292859] env[69692]: INFO networking_nsxv3.common.synchronization [req-7586e263-e65e-44c6-b7c5-72e9dd280209 req-f0517d1b-6bc8-4d90-b934-a20ed54745c4 service nova] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1188.292859] env[69692]: INFO networking_nsxv3.common.synchronization [req-7586e263-e65e-44c6-b7c5-72e9dd280209 req-f0517d1b-6bc8-4d90-b934-a20ed54745c4 service nova] Enqueued Resource ID: 235bb715-0a41-441e-b0d2-c5606ae4a5fd with Priority: HIGHEST for action port [ 1188.293288] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_rules [ 1188.293288] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1188.293288] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 235bb715-0a41-441e-b0d2-c5606ae4a5fd with Priority: HIGHEST for action port [ 1188.295411] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.295411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.295411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.295411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.295411] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.295411] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.295411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.295871] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-235bb715-0a41-441e-b0d2-c5606ae4a5fd taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.295871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-235bb715-0a41-441e-b0d2-c5606ae4a5fd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.295871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-235bb715-0a41-441e-b0d2-c5606ae4a5fd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.295871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-235bb715-0a41-441e-b0d2-c5606ae4a5fd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.296032] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('235bb715-0a41-441e-b0d2-c5606ae4a5fd',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.390445] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.390887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.390887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.390995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.391087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.391344] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be updated. [ 1188.421199] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.421432] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.421432] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.421615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.421762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.434315] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: IN_PROGRESS for 2s [ 1188.651860] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.651951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.652049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.652247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.652463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.652578] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.652684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.652733] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.652893] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.652985] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.653086] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 is going to be updated. [ 1188.677877] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.678092] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.678092] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.678368] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.678452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.686313] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 in Status: IN_PROGRESS for 2s [ 1188.800679] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 235bb715-0a41-441e-b0d2-c5606ae4a5fd with status ACTIVE [ 1188.800760] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.800879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.800949] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.801228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.801329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.801517] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.801621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.801684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.801837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.801914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.802110] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.802205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.802278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.802407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.802483] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.802565] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 235bb715-0a41-441e-b0d2-c5606ae4a5fd is going to be updated. [ 1188.803708] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.803820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.823916] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.824029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.824073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.825029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.825029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.825029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-235bb715-0a41-441e-b0d2-c5606ae4a5fd" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.211317] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: SUCCESS [ 1189.211495] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 deletion is rescheduled due to dependency. [ 1189.211607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.211746] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.212164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.212164] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.212332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.212332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.213197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.213197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.213197] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.714318] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.966635] env[69692]: INFO networking_nsxv3.common.synchronization [req-6a81b773-831f-40fd-8e9e-340d81bdbf3c req-bb1a0562-c251-482d-9e97-ced3e4229493 tempest-ServerGroupTestJSON-1448874844 tempest-ServerGroupTestJSON-1448874844-project-member] Enqueued Resource ID: 0437342b-6575-4c08-8d68-72455f1041f3 with Priority: HIGHEST for action security_group_members [ 1189.966635] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0437342b-6575-4c08-8d68-72455f1041f3 with Priority: HIGHEST for action security_group_members [ 1189.966635] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-0437342b-6575-4c08-8d68-72455f1041f3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.966635] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.967476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.968108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.968425] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.969619] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.969619] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.969827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.970012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.970194] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0437342b-6575-4c08-8d68-72455f1041f3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.217081] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.467281] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: SUCCESS [ 1190.467507] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.467760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.468703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.468703] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.468703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.468703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.468703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.468703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.468703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.468703] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.473497] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.473615] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.473684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.473851] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.473935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.474125] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.474241] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.474303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.474412] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.474477] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.474564] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0437342b-6575-4c08-8d68-72455f1041f3 is going to be updated. [ 1190.501943] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.502107] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.502180] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.502388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.502523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.510359] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0437342b-6575-4c08-8d68-72455f1041f3 in Status: IN_PROGRESS for 2s [ 1190.697773] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 in Status: SUCCESS [ 1190.697773] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e3fa94e-ad64-4239-ae57-26fdc5531217 deletion is rescheduled due to dependency. [ 1190.697773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e3fa94e-ad64-4239-ae57-26fdc5531217" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.719850] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.720199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.720199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.720374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.720465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.720561] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 is going to be updated. [ 1190.748271] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.748411] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.748466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.748642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.748794] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.756971] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: IN_PROGRESS for 2s [ 1190.974926] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.483168] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d450c5a-e2df-45be-a358-d8fce8ee7d24: rpc.has_security_group_logging(os_id): False [ 1191.501573] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.501864] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.501985] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.502270] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.502415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.502718] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.503246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.503246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.503246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.503246] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.503420] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be updated. [ 1191.570031] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.570031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.570031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.570031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.570316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.583543] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: IN_PROGRESS for 2s [ 1192.521188] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0437342b-6575-4c08-8d68-72455f1041f3 in Status: SUCCESS [ 1192.521486] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0437342b-6575-4c08-8d68-72455f1041f3 deletion is rescheduled due to dependency. [ 1192.521537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.766963] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: SUCCESS [ 1192.767209] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.767315] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.767528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.767721] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.767840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.767902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.768075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.768149] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.768237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.768556] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.274590] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.598788] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: SUCCESS [ 1193.599236] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.776791] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c27a619-83e9-4ab1-a7c8-d2d45bd50134: rpc.has_security_group_logging(os_id): False [ 1193.793780] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.793945] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.793992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.794226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.794317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.794563] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.794662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.794719] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.794930] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.795013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.795102] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 is going to be updated. [ 1193.867122] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.867289] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.867347] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.867547] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.867692] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.879795] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: IN_PROGRESS for 2s [ 1194.967041] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1194.967373] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1195.895398] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: SUCCESS [ 1195.895398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.384515] env[69692]: INFO networking_nsxv3.common.synchronization [req-60266cef-d539-48ab-9cdf-3d95717fc187 req-b930d0f7-87c7-4875-a457-36ac73836b3a tempest-ServersNegativeTestJSON-162754182 tempest-ServersNegativeTestJSON-162754182-project-member] Enqueued Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1197.385841] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1197.386018] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.386164] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.386238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.386451] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.386608] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.386710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.386773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.386922] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.387019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.387134] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.889760] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.092281] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-206 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.092512] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-206" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.092646] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-206" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.092944] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-206" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.093236] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.093400] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.093526] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.093804] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.093959] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.094677] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.095197] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.095197] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.095197] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.095448] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1198.096164] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.096427] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.118579] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.118895] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1198.118986] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.119214] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-206" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.119583] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-74c65684-7d1d-429b-bbf6-dd1ca0e947e5 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.119771] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-74c65684-7d1d-429b-bbf6-dd1ca0e947e5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.119922] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-74c65684-7d1d-429b-bbf6-dd1ca0e947e5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.120274] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-74c65684-7d1d-429b-bbf6-dd1ca0e947e5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.120419] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74c65684-7d1d-429b-bbf6-dd1ca0e947e5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.391697] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.624186] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.624186] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.624186] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.624186] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.624667] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.624934] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 74c65684-7d1d-429b-bbf6-dd1ca0e947e5 not found, creating... [ 1198.625278] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.625512] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.625676] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.625986] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.626225] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.626582] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.626794] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.626971] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.627267] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.627613] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.627817] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 74c65684-7d1d-429b-bbf6-dd1ca0e947e5 is going to be created. [ 1198.647450] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.647897] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.648163] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.648542] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.648832] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.649145] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-74c65684-7d1d-429b-bbf6-dd1ca0e947e5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.894570] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.895022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.896024] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.896024] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.896024] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.896024] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 is going to be updated. [ 1198.968382] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.968562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.968610] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.968800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.968933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.977741] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: IN_PROGRESS for 2s [ 1199.372266] env[69692]: INFO networking_nsxv3.common.synchronization [None req-c775c99b-5afb-4a61-9da3-38470ddd1d21 None None] Enqueued Resource ID: 70fb5c05-ea24-42b5-baa7-96c4f3affae3 with Priority: HIGHEST for action port [ 1199.372534] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fb5c05-ea24-42b5-baa7-96c4f3affae3 with Priority: HIGHEST for action port [ 1199.373266] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-70fb5c05-ea24-42b5-baa7-96c4f3affae3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.373266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70fb5c05-ea24-42b5-baa7-96c4f3affae3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.373462] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70fb5c05-ea24-42b5-baa7-96c4f3affae3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.373580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70fb5c05-ea24-42b5-baa7-96c4f3affae3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.373667] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70fb5c05-ea24-42b5-baa7-96c4f3affae3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.498031] env[69692]: INFO networking_nsxv3.common.synchronization [req-60266cef-d539-48ab-9cdf-3d95717fc187 req-cafca389-9d8c-403d-b6ce-592024976002 service nova] Enqueued Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_rules [ 1199.498031] env[69692]: INFO networking_nsxv3.common.synchronization [req-60266cef-d539-48ab-9cdf-3d95717fc187 req-cafca389-9d8c-403d-b6ce-592024976002 service nova] Enqueued Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1199.498031] env[69692]: INFO networking_nsxv3.common.synchronization [req-60266cef-d539-48ab-9cdf-3d95717fc187 req-cafca389-9d8c-403d-b6ce-592024976002 service nova] Enqueued Resource ID: 74c65684-7d1d-429b-bbf6-dd1ca0e947e5 with Priority: HIGHEST for action port [ 1199.498031] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_rules [ 1199.498031] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1199.498031] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c65684-7d1d-429b-bbf6-dd1ca0e947e5 with Priority: HIGHEST for action port [ 1199.498031] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.498031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.498710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.498710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.498788] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.499599] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.499691] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.500848] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-74c65684-7d1d-429b-bbf6-dd1ca0e947e5 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.500848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74c65684-7d1d-429b-bbf6-dd1ca0e947e5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.500848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74c65684-7d1d-429b-bbf6-dd1ca0e947e5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.500848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74c65684-7d1d-429b-bbf6-dd1ca0e947e5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.500848] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74c65684-7d1d-429b-bbf6-dd1ca0e947e5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.876595] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70fb5c05-ea24-42b5-baa7-96c4f3affae3 [ 1199.876839] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.876950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.877033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.877324] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.877653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.877653] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70fb5c05-ea24-42b5-baa7-96c4f3affae3 already deleted. [ 1199.877653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70fb5c05-ea24-42b5-baa7-96c4f3affae3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.002635] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.002748] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.002958] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74c65684-7d1d-429b-bbf6-dd1ca0e947e5 with status ACTIVE [ 1200.003145] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.003258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.003313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.003518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.003599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.003762] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.005019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.005019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.005019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.005019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.005019] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.005019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.005019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.005019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.005019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.005019] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74c65684-7d1d-429b-bbf6-dd1ca0e947e5 is going to be updated. [ 1200.026482] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.026650] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.026696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.027325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.027325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.027325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74c65684-7d1d-429b-bbf6-dd1ca0e947e5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.990813] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: SUCCESS [ 1200.994018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.994018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.994018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.994018] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.994018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.994018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.994018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.994018] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.994018] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.495733] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.510651] env[69692]: INFO networking_nsxv3.common.synchronization [None req-4149d841-2ca5-4751-8488-dee289f6f620 None None] Enqueued Resource ID: ede16bd6-864e-403a-ac22-37083e87c109 with Priority: HIGHEST for action port [ 1201.510915] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ede16bd6-864e-403a-ac22-37083e87c109 with Priority: HIGHEST for action port [ 1201.511478] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-ede16bd6-864e-403a-ac22-37083e87c109 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.511605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ede16bd6-864e-403a-ac22-37083e87c109" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.511673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ede16bd6-864e-403a-ac22-37083e87c109" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.511934] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ede16bd6-864e-403a-ac22-37083e87c109" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.512242] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ede16bd6-864e-403a-ac22-37083e87c109',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.796498] env[69692]: INFO networking_nsxv3.common.synchronization [None req-a2fdcd69-d833-46da-81fd-031414101e1c None None] Enqueued Resource ID: f2368d04-a00d-4833-8f20-2a96ba167856 with Priority: HIGHEST for action port [ 1201.796498] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2368d04-a00d-4833-8f20-2a96ba167856 with Priority: HIGHEST for action port [ 1201.796498] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2368d04-a00d-4833-8f20-2a96ba167856 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.796498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2368d04-a00d-4833-8f20-2a96ba167856" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.796498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2368d04-a00d-4833-8f20-2a96ba167856" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.801756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2368d04-a00d-4833-8f20-2a96ba167856" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.801756] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2368d04-a00d-4833-8f20-2a96ba167856',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.998399] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.014097] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ede16bd6-864e-403a-ac22-37083e87c109 [ 1202.014372] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.014469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.014525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.014727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.014815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.014908] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ede16bd6-864e-403a-ac22-37083e87c109 already deleted. [ 1202.015017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ede16bd6-864e-403a-ac22-37083e87c109" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.302020] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2368d04-a00d-4833-8f20-2a96ba167856 [ 1202.302020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.302020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.302020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.302020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.302020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.302020] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2368d04-a00d-4833-8f20-2a96ba167856 already deleted. [ 1202.302020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2368d04-a00d-4833-8f20-2a96ba167856" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.501012] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.501188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.501282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.501469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.501560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.501659] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 is going to be updated. [ 1202.531902] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.531902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.531902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.531902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.531902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.538556] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: IN_PROGRESS for 2s [ 1203.781318] env[69692]: INFO networking_nsxv3.common.synchronization [None req-6fc9f3b3-82f5-4a73-b619-a620311711f4 None None] Enqueued Resource ID: a765fdec-db3b-4c1a-aa76-b5e0e91affe4 with Priority: HIGHEST for action port [ 1203.781318] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a765fdec-db3b-4c1a-aa76-b5e0e91affe4 with Priority: HIGHEST for action port [ 1203.781318] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-a765fdec-db3b-4c1a-aa76-b5e0e91affe4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.781318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a765fdec-db3b-4c1a-aa76-b5e0e91affe4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.781318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a765fdec-db3b-4c1a-aa76-b5e0e91affe4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.781318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a765fdec-db3b-4c1a-aa76-b5e0e91affe4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.781318] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a765fdec-db3b-4c1a-aa76-b5e0e91affe4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.284154] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a765fdec-db3b-4c1a-aa76-b5e0e91affe4 [ 1204.284441] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.284605] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.284709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.284989] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.285120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.285233] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a765fdec-db3b-4c1a-aa76-b5e0e91affe4 already deleted. [ 1204.285326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a765fdec-db3b-4c1a-aa76-b5e0e91affe4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.549271] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: SUCCESS [ 1204.549458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.549642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.549918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.550073] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.550218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.550251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.550414] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.550499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.550584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.550691] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.938048] env[69692]: INFO networking_nsxv3.common.synchronization [req-cea8a536-d64d-4b95-8398-6bdef5f6f43e req-2fb9a1e8-5143-4e95-ac9a-8439d0dab957 tempest-AttachVolumeShelveTestJSON-1120054663 tempest-AttachVolumeShelveTestJSON-1120054663-project-member] Enqueued Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_members [ 1204.938671] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a948ef5d-7e31-413f-8d23-aa989234c539 with Priority: HIGHEST for action security_group_members [ 1204.939008] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a948ef5d-7e31-413f-8d23-aa989234c539 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.939142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.939211] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.939473] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.939628] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.939726] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.939786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.939939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.940031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.940127] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a948ef5d-7e31-413f-8d23-aa989234c539',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.054351] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.054498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.054567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.054779] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.054928] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.055053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.055121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.055276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.055362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.055452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.055598] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.055689] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.055750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.055907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.056116] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.056213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.056287] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.056468] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.056509] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.056587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.056672] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.442438] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.442438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.442438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.442701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.442701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.442925] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.443087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.443148] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.443320] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.443397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.443445] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a948ef5d-7e31-413f-8d23-aa989234c539 is going to be updated. [ 1205.475319] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.475451] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.475527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.475698] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.475834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.484232] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a948ef5d-7e31-413f-8d23-aa989234c539 in Status: IN_PROGRESS for 2s [ 1205.559742] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3dc0cc02-0477-4365-b448-c823c1d0ff33: rpc.has_security_group_logging(os_id): False [ 1205.576588] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.576810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.576810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.576998] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.577116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.577310] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.577441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.577479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.577613] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.577690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.577885] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.577979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.578051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.578192] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.578261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.578832] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.578832] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.578832] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.578832] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.578832] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.578832] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 is going to be updated. [ 1205.641326] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.641526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.641600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.641814] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.641961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.656958] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: IN_PROGRESS for 2s [ 1207.053925] env[69692]: INFO networking_nsxv3.common.synchronization [req-d0b27934-6363-49a1-8d85-99a2c0f8ae4c req-73f0232e-06e8-43af-9adb-d8bada419f40 tempest-ServersNegativeTestMultiTenantJSON-2055751609 tempest-ServersNegativeTestMultiTenantJSON-2055751609-project-member] Enqueued Resource ID: 959327f1-c8f9-4b93-8465-81e781bdec37 with Priority: HIGHEST for action security_group_members [ 1207.054383] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 959327f1-c8f9-4b93-8465-81e781bdec37 with Priority: HIGHEST for action security_group_members [ 1207.054694] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-959327f1-c8f9-4b93-8465-81e781bdec37 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.054816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.054886] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.055607] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.055776] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.055883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.055951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.056125] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.056219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.056314] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('959327f1-c8f9-4b93-8465-81e781bdec37',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.342682] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-551 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.342894] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-551" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.343048] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-551" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.343408] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-551" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.343679] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.343841] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.343964] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.344231] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.344416] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.344639] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.344773] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.344887] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.345019] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.345162] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.345276] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.345412] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.365741] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.365903] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1207.366090] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.366295] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-551" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.366591] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-8e006288-1ae7-4640-83af-62e9dfe075e4 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.366760] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-8e006288-1ae7-4640-83af-62e9dfe075e4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.366880] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-8e006288-1ae7-4640-83af-62e9dfe075e4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.367210] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-8e006288-1ae7-4640-83af-62e9dfe075e4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.367354] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e006288-1ae7-4640-83af-62e9dfe075e4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.508761] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a948ef5d-7e31-413f-8d23-aa989234c539 in Status: SUCCESS [ 1207.508955] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a948ef5d-7e31-413f-8d23-aa989234c539 deletion is rescheduled due to dependency. [ 1207.509088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a948ef5d-7e31-413f-8d23-aa989234c539" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.559376] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.559510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.559556] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.559846] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.560022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.560278] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.560486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.560550] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.560718] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.561150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.561150] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 959327f1-c8f9-4b93-8465-81e781bdec37 already deleted. [ 1207.561150] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.671506] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: SUCCESS [ 1207.671506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.873282] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.873521] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.873653] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.873939] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.874107] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.874273] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 8e006288-1ae7-4640-83af-62e9dfe075e4 not found, creating... [ 1207.874531] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.874691] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.874812] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.875131] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.875378] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.875652] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.875816] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.875936] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.876279] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.876425] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.876570] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 8e006288-1ae7-4640-83af-62e9dfe075e4 is going to be created. [ 1207.897342] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.897546] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.897675] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.897937] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.898188] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.898430] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-8e006288-1ae7-4640-83af-62e9dfe075e4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.555367] env[69692]: INFO networking_nsxv3.common.synchronization [req-d0b27934-6363-49a1-8d85-99a2c0f8ae4c req-15c6a623-7136-45a6-b21f-4064b1a8eb05 service nova] Enqueued Resource ID: 959327f1-c8f9-4b93-8465-81e781bdec37 with Priority: HIGHEST for action security_group_rules [ 1208.555622] env[69692]: INFO networking_nsxv3.common.synchronization [req-d0b27934-6363-49a1-8d85-99a2c0f8ae4c req-15c6a623-7136-45a6-b21f-4064b1a8eb05 service nova] Enqueued Resource ID: 959327f1-c8f9-4b93-8465-81e781bdec37 with Priority: HIGHEST for action security_group_members [ 1208.555719] env[69692]: INFO networking_nsxv3.common.synchronization [req-d0b27934-6363-49a1-8d85-99a2c0f8ae4c req-15c6a623-7136-45a6-b21f-4064b1a8eb05 service nova] Enqueued Resource ID: 8e006288-1ae7-4640-83af-62e9dfe075e4 with Priority: HIGHEST for action port [ 1208.555904] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 959327f1-c8f9-4b93-8465-81e781bdec37 with Priority: HIGHEST for action security_group_rules [ 1208.556078] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 959327f1-c8f9-4b93-8465-81e781bdec37 with Priority: HIGHEST for action security_group_members [ 1208.556204] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e006288-1ae7-4640-83af-62e9dfe075e4 with Priority: HIGHEST for action port [ 1208.556714] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-959327f1-c8f9-4b93-8465-81e781bdec37 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.556874] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.556990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.557217] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.557301] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('959327f1-c8f9-4b93-8465-81e781bdec37',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.558105] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-959327f1-c8f9-4b93-8465-81e781bdec37 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.558217] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.558309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.558443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.558659] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.558738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.558738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.558881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.558938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.559067] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('959327f1-c8f9-4b93-8465-81e781bdec37',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.559703] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e006288-1ae7-4640-83af-62e9dfe075e4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.559806] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e006288-1ae7-4640-83af-62e9dfe075e4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.559879] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e006288-1ae7-4640-83af-62e9dfe075e4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.560028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e006288-1ae7-4640-83af-62e9dfe075e4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.560100] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e006288-1ae7-4640-83af-62e9dfe075e4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.061973] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('959327f1-c8f9-4b93-8465-81e781bdec37',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.063370] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-959327f1-c8f9-4b93-8465-81e781bdec37 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.063486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.063906] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e006288-1ae7-4640-83af-62e9dfe075e4 with status ACTIVE [ 1209.064015] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.064128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.064193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.064396] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.064504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.064650] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.064729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.064791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.064942] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.065069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.065246] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.065340] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.065401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.065538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.065612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.065692] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e006288-1ae7-4640-83af-62e9dfe075e4 is going to be updated. [ 1209.087675] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.087800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.087850] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.088065] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.088388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.088388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e006288-1ae7-4640-83af-62e9dfe075e4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.564225] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('959327f1-c8f9-4b93-8465-81e781bdec37',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.066943] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.066943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.066943] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.067355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.067355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.067355] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 959327f1-c8f9-4b93-8465-81e781bdec37 is going to be created. [ 1210.090229] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.090426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.090479] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.090649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.090808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.099567] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 959327f1-c8f9-4b93-8465-81e781bdec37 in Status: UNINITIALIZED for 2s [ 1210.554924] env[69692]: INFO networking_nsxv3.common.synchronization [req-6b27d1e9-4c0c-4c62-827d-fdf203e0a9d5 req-4ac0a44f-23bb-4009-8058-fa2ccad5ba84 tempest-ServersNegativeTestJSON-162754182 tempest-ServersNegativeTestJSON-162754182-project-member] Enqueued Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1210.555553] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1210.555915] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.556070] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.556202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.556500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.556744] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.556906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.557029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.557356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.557447] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.557508] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.059677] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.562208] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.065431] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.066129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.066129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.066129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.066129] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.066129] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 is going to be updated. [ 1212.103793] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.104031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.104031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.104205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.104335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.116123] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: IN_PROGRESS for 2s [ 1212.116727] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 959327f1-c8f9-4b93-8465-81e781bdec37 in Status: SUCCESS [ 1212.116914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.117081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.117280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.117486] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.117599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.117662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.117820] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.117908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.117986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.118086] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('959327f1-c8f9-4b93-8465-81e781bdec37',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.620091] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-959327f1-c8f9-4b93-8465-81e781bdec37 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.620265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.620394] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.620729] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.621539] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.621539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.621539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.621539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.621539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.621539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.621539] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-959327f1-c8f9-4b93-8465-81e781bdec37 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.621848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.621848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.621848] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.621988] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.622088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.622134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.622245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.622309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.622395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.622486] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('959327f1-c8f9-4b93-8465-81e781bdec37',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.124797] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 959327f1-c8f9-4b93-8465-81e781bdec37: rpc.has_security_group_logging(os_id): False [ 1213.148042] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.148188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.148256] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.148464] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.148554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.148743] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.148840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.148902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.149083] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.149188] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.149354] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.149445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.149616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.149754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.149754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.149903] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.149996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.150071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.150213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.150292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.150489] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 959327f1-c8f9-4b93-8465-81e781bdec37 is going to be created. [ 1213.257804] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.257939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.257939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.258149] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.258334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.272252] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 959327f1-c8f9-4b93-8465-81e781bdec37 in Status: IN_PROGRESS for 2s [ 1214.129414] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: IN_PROGRESS for 4s [ 1215.288020] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 959327f1-c8f9-4b93-8465-81e781bdec37 in Status: SUCCESS [ 1215.288361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.556910] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1215.556910] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1216.137801] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: SUCCESS [ 1216.138052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.557647] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1220.557980] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1220.593542] env[69692]: INFO networking_nsxv3.common.synchronization [req-577c9a10-3707-4273-b623-c362ffb86985 req-73d877ec-390f-49f1-8db2-b03526cb750a tempest-ServersNegativeTestMultiTenantJSON-2055751609 tempest-ServersNegativeTestMultiTenantJSON-2055751609-project-member] Enqueued Resource ID: 959327f1-c8f9-4b93-8465-81e781bdec37 with Priority: HIGHEST for action security_group_members [ 1220.594798] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 959327f1-c8f9-4b93-8465-81e781bdec37 with Priority: HIGHEST for action security_group_members [ 1220.596295] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-959327f1-c8f9-4b93-8465-81e781bdec37 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.596429] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.596543] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.596760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.597542] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.597681] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.597780] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.599630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.599630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.599630] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('959327f1-c8f9-4b93-8465-81e781bdec37',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.103055] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.103278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.103278] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.103438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.103532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.103727] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.103824] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.103887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.104051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.104130] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.104219] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 959327f1-c8f9-4b93-8465-81e781bdec37 is going to be updated. [ 1221.132715] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.132872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.132936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.133194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.133306] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.141667] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 959327f1-c8f9-4b93-8465-81e781bdec37 in Status: IN_PROGRESS for 2s [ 1223.153096] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 959327f1-c8f9-4b93-8465-81e781bdec37 in Status: SUCCESS [ 1223.153511] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 959327f1-c8f9-4b93-8465-81e781bdec37 deletion is rescheduled due to dependency. [ 1223.153745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.596012] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1225.596299] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1230.597247] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1230.597592] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1235.598553] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1235.598553] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1235.747717] env[69692]: INFO networking_nsxv3.common.synchronization [req-7a31eb4d-5d25-4f66-bc9f-4368c5575651 req-29739b51-4c3f-48ea-b329-7f87bb8eff97 tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 with Priority: HIGHEST for action security_group_members [ 1235.748435] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 with Priority: HIGHEST for action security_group_members [ 1235.748843] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cdd9a71-efff-486a-bba8-192e985b48d0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.748991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.749142] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.749439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.749680] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.749849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.749963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.750213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.750361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.750516] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cdd9a71-efff-486a-bba8-192e985b48d0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.253207] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.253371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.253451] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.253657] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.253753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.253949] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.254059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.254118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.254280] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.254361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.254451] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 is going to be updated. [ 1236.294901] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.295071] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.295130] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.295389] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.295539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.308829] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 in Status: IN_PROGRESS for 2s [ 1236.529038] env[69692]: INFO networking_nsxv3.common.synchronization [req-3542ab12-e911-48bd-8fab-f10bc956cc42 req-fc317177-c209-4a5b-a734-394fd6e72788 tempest-AttachVolumeNegativeTest-1900946284 tempest-AttachVolumeNegativeTest-1900946284-project-member] Enqueued Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGHEST for action security_group_members [ 1236.529038] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGHEST for action security_group_members [ 1236.530745] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-110f090f-7c2e-4e86-a35e-37ed29bc880a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.532064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.532064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.532064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.532064] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.532064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.532064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.532064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.532064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.532526] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('110f090f-7c2e-4e86-a35e-37ed29bc880a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.035738] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.035738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.035738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.035738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.035738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.036406] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.036406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.036406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.036406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.036406] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.036704] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a is going to be updated. [ 1237.065510] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.065696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.065801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.066100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.066293] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.075028] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a in Status: IN_PROGRESS for 2s [ 1238.319785] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 in Status: SUCCESS [ 1238.319785] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cdd9a71-efff-486a-bba8-192e985b48d0 deletion is rescheduled due to dependency. [ 1238.319785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cdd9a71-efff-486a-bba8-192e985b48d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.085937] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a in Status: SUCCESS [ 1239.085937] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a deletion is rescheduled due to dependency. [ 1239.086249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.531790] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1241.532452] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1246.533108] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1246.533495] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1246.721404] env[69692]: INFO networking_nsxv3.common.synchronization [req-76cb75b9-4e97-46df-99da-75bc9b389cde req-dab64430-8b9b-42c2-b274-fa4c1a3bc901 tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_members [ 1246.721876] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_members [ 1246.722592] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.722592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.722592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.722592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.722870] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.722870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.722870] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.723050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.723088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.723227] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.999035] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-630 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.999302] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.999437] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.999712] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.999979] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.000147] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.000288] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.000481] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.000627] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.000841] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1247.000957] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1247.001081] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1247.001193] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1247.001305] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1247.001413] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1247.001545] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1247.021178] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1247.021337] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1247.021476] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1247.021640] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.021918] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.022091] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.022211] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.022518] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.023341] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f0e6723-6338-4b46-96c9-5f2b7f6958f8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.224812] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.224987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.225052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.225282] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.225375] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.225607] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.225709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.225769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.225918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.225994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.226093] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 is going to be updated. [ 1247.256398] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.256630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.256690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.256911] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.257064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.268680] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: IN_PROGRESS for 2s [ 1247.525164] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.525452] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.525452] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.525782] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.525992] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.526183] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 4f0e6723-6338-4b46-96c9-5f2b7f6958f8 not found, creating... [ 1247.526476] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.526709] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.526952] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.527286] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.527454] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.527885] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.528146] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.528286] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.528513] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.528681] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.528877] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 4f0e6723-6338-4b46-96c9-5f2b7f6958f8 is going to be created. [ 1247.548613] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.548927] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.548985] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.549255] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.549480] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.549702] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.244347] env[69692]: INFO networking_nsxv3.common.synchronization [req-76cb75b9-4e97-46df-99da-75bc9b389cde req-70ca7274-e441-4a25-b8a1-fe97bfd5442b service nova] Enqueued Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_rules [ 1248.244532] env[69692]: INFO networking_nsxv3.common.synchronization [req-76cb75b9-4e97-46df-99da-75bc9b389cde req-70ca7274-e441-4a25-b8a1-fe97bfd5442b service nova] Enqueued Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_members [ 1248.244680] env[69692]: INFO networking_nsxv3.common.synchronization [req-76cb75b9-4e97-46df-99da-75bc9b389cde req-70ca7274-e441-4a25-b8a1-fe97bfd5442b service nova] Enqueued Resource ID: 4f0e6723-6338-4b46-96c9-5f2b7f6958f8 with Priority: HIGHEST for action port [ 1248.244899] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_rules [ 1248.245034] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_members [ 1248.245132] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f0e6723-6338-4b46-96c9-5f2b7f6958f8 with Priority: HIGHEST for action port [ 1248.245967] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.245967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.245967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.246116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.246182] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.247400] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.247493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.247684] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.247791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.247847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.248931] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.248931] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f0e6723-6338-4b46-96c9-5f2b7f6958f8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.749996] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.750361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.750361] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f0e6723-6338-4b46-96c9-5f2b7f6958f8 with status ACTIVE [ 1248.750458] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.750564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.750630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.750896] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.750981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.751801] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.751801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.751801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.751801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.751801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.751801] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.751801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.751801] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.752332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.752332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.752332] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f0e6723-6338-4b46-96c9-5f2b7f6958f8 is going to be updated. [ 1248.772458] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.772647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.772752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.773035] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.773247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.773490] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.278968] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: SUCCESS [ 1249.278968] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 deletion is rescheduled due to dependency. [ 1249.278968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.278968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.279271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.279374] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.279521] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.279617] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.279706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.279786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.279880] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.782635] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.284981] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.786373] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.786690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.786690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.786846] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.786936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.787041] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 is going to be updated. [ 1250.813396] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.813534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.813601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.813790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.813930] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.821631] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: IN_PROGRESS for 2s [ 1252.832967] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: SUCCESS [ 1252.833245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.833399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.833636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.833827] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.833994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.834075] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.834237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.834318] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.834405] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.834494] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.076703] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-206 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.076939] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-206" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.077079] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-206" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.077443] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-206" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.077733] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.077905] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.078036] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.078266] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.078413] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.078619] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1253.078740] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1253.078852] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1253.078964] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1253.079090] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1253.079200] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1253.079337] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1253.100774] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1253.100836] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1253.100941] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1253.101142] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-206" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.101442] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.101612] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.101733] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.101992] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.102147] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8451a21e-0abb-4e9a-bb44-1e2fafbd8503',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.245873] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1253.246060] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1253.340954] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.340954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.340954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.340954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.340954] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.340954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.340954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.340954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.340954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.340954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.340954] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.340954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.340954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.340954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.340954] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.340954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.341601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.341601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.341601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.341601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.341601] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.607019] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.607019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.607019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.607019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.607019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.607019] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.607019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.607019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.607019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.607019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.607944] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.607944] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.607944] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.607944] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.608161] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.608528] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 8451a21e-0abb-4e9a-bb44-1e2fafbd8503 is going to be updated. [ 1253.631151] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.631151] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.631151] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.631151] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.631151] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.631151] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.841807] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419: rpc.has_security_group_logging(os_id): False [ 1253.863271] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.863484] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.863484] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.863846] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.863956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.864205] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.864305] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.864387] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.864528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.864609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.864813] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.864909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.864963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.865130] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.865205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.865389] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.865482] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.865560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.865734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.865812] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.865916] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 is going to be updated. [ 1253.925267] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.925425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.925486] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.925723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.925876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.953976] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: IN_PROGRESS for 2s [ 1254.385344] env[69692]: INFO networking_nsxv3.common.synchronization [req-360bc164-ec83-421d-a6b6-624523e263c7 req-f2127b44-1ba5-417c-ab17-9c66d17872ec service nova] Enqueued Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_rules [ 1254.385537] env[69692]: INFO networking_nsxv3.common.synchronization [req-360bc164-ec83-421d-a6b6-624523e263c7 req-f2127b44-1ba5-417c-ab17-9c66d17872ec service nova] Enqueued Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1254.385769] env[69692]: INFO networking_nsxv3.common.synchronization [req-360bc164-ec83-421d-a6b6-624523e263c7 req-f2127b44-1ba5-417c-ab17-9c66d17872ec service nova] Enqueued Resource ID: 8451a21e-0abb-4e9a-bb44-1e2fafbd8503 with Priority: HIGHEST for action port [ 1254.386439] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_rules [ 1254.386585] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1254.386711] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8451a21e-0abb-4e9a-bb44-1e2fafbd8503 with Priority: HIGHEST for action port [ 1254.386986] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.387253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.387253] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.387400] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.387500] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.388370] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.388462] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.388529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.388695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.389190] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.389398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.389398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.389527] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.389688] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.389688] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.390434] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.390540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.390608] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.390758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.390830] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8451a21e-0abb-4e9a-bb44-1e2fafbd8503',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.893053] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.893053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.894785] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.895253] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8451a21e-0abb-4e9a-bb44-1e2fafbd8503 with status ACTIVE [ 1254.895430] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.895572] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.895645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.896099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.896099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.896262] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.896262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.896346] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.896503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.896589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.896733] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.896837] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.896894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.897022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.897128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.897184] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8451a21e-0abb-4e9a-bb44-1e2fafbd8503 is going to be updated. [ 1254.916489] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.916641] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.916711] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.916925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.917077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.917234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8451a21e-0abb-4e9a-bb44-1e2fafbd8503" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.399938] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.902785] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.902785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.902785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.902785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.902785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.902785] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 is going to be updated. [ 1255.903801] env[69692]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1255.903910] env[69692]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-90cba59e-6526-4c6b-b52c-294350d688bd None None] NSXv3 Agent Agent loop - iteration:3 started [ 1255.931139] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.931139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.931139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.931139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.931139] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.940636] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: IN_PROGRESS for 2s [ 1255.966905] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: SUCCESS [ 1255.967155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.518228] env[69692]: INFO networking_nsxv3.common.synchronization [req-7d3bfe15-3025-4725-ae46-d5ed334d54bf req-a1363ef4-a4a2-4491-b50b-3a36f2385b9d tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_members [ 1257.518733] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGHEST for action security_group_members [ 1257.519050] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.519186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.519255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.519504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.519633] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.519714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.519714] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.519959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.520094] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.520183] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.559338] env[69692]: INFO networking_nsxv3.common.synchronization [req-7d3bfe15-3025-4725-ae46-d5ed334d54bf req-a1363ef4-a4a2-4491-b50b-3a36f2385b9d tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: 4f0e6723-6338-4b46-96c9-5f2b7f6958f8 with Priority: HIGHEST for action port [ 1257.559861] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f0e6723-6338-4b46-96c9-5f2b7f6958f8 with Priority: HIGHEST for action port [ 1257.560220] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.560370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.560450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.560673] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.560781] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f0e6723-6338-4b46-96c9-5f2b7f6958f8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.949657] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: SUCCESS [ 1257.949893] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.950086] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.950380] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.951029] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.951029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.951029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.951029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.951284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.951284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.951284] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.022976] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.023331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.023331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.023460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.023638] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.023862] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.023987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.024096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.024264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.024346] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.024438] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 is going to be updated. [ 1258.048725] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.048908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.048978] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.049176] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.049316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.057253] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: IN_PROGRESS for 2s [ 1258.062628] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f0e6723-6338-4b46-96c9-5f2b7f6958f8 with status ACTIVE [ 1258.062848] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.062964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.063043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.063257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.063340] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.063524] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.063632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.063711] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.063873] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.063951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.064149] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.064245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.064298] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.064443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.064513] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.064593] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f0e6723-6338-4b46-96c9-5f2b7f6958f8 is going to be updated. [ 1258.082940] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.083093] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.083166] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.083360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.083494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.083676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f0e6723-6338-4b46-96c9-5f2b7f6958f8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.454249] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.454447] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.454515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.454778] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.454962] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.455148] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.455148] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.455295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.455380] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.455504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.455807] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.455937] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.456028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.456227] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.456390] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.456503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.456565] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.456764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.456862] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.456950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.457142] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.961487] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3dc0cc02-0477-4365-b448-c823c1d0ff33: rpc.has_security_group_logging(os_id): False [ 1258.990517] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.990716] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.990716] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.991049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.991175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.991400] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.991545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.991612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.991734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.991814] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.992059] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.992178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.992261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.992382] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.992454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.992679] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.992810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.992883] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.993021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.993107] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.993173] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 is going to be updated. [ 1259.054814] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.055051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.055141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.055395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.055600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.068178] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: IN_PROGRESS for 2s [ 1260.067765] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 in Status: SUCCESS [ 1260.068156] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 deletion is rescheduled due to dependency. [ 1260.068156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.083798] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: SUCCESS [ 1261.084183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.071794] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-199 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.072029] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.072172] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.072486] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.072766] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.072930] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.073061] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.073293] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.073501] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.073840] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1262.073971] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1262.074096] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1262.074211] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1262.074384] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1262.074544] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1262.074688] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1262.092358] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1262.092700] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1262.092755] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1262.093017] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-199" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.093372] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-07e722ee-52b4-4ea2-a403-342bdceeb278 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.093549] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.093676] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.093934] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.094082] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07e722ee-52b4-4ea2-a403-342bdceeb278',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.561512] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.561512] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1262.596107] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.596497] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.596575] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.596896] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.597084] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.597398] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.597569] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.597719] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.597965] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.598125] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.598425] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.598582] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.598813] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.599048] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.599193] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.599341] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 07e722ee-52b4-4ea2-a403-342bdceeb278 is going to be updated. [ 1262.621025] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.621247] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.621399] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.621648] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.621852] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.622097] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.329226] env[69692]: INFO networking_nsxv3.common.synchronization [req-5d788fa2-bd33-4bc0-ab30-b374fa27208a req-c4d5f4a0-7488-4787-a68a-d07477bbe58c service nova] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_rules [ 1263.329483] env[69692]: INFO networking_nsxv3.common.synchronization [req-5d788fa2-bd33-4bc0-ab30-b374fa27208a req-c4d5f4a0-7488-4787-a68a-d07477bbe58c service nova] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1263.329557] env[69692]: INFO networking_nsxv3.common.synchronization [req-5d788fa2-bd33-4bc0-ab30-b374fa27208a req-c4d5f4a0-7488-4787-a68a-d07477bbe58c service nova] Enqueued Resource ID: 07e722ee-52b4-4ea2-a403-342bdceeb278 with Priority: HIGHEST for action port [ 1263.329788] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_rules [ 1263.329975] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1263.330157] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07e722ee-52b4-4ea2-a403-342bdceeb278 with Priority: HIGHEST for action port [ 1263.331161] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.331299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.331369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.331578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.331662] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.332540] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.332651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.332721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.332891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.333054] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.333162] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.333203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.333373] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.333460] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.333554] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.334318] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-07e722ee-52b4-4ea2-a403-342bdceeb278 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.334434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.334499] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.334654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.334732] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07e722ee-52b4-4ea2-a403-342bdceeb278',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.836927] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.838276] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.838428] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.838610] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07e722ee-52b4-4ea2-a403-342bdceeb278 with status ACTIVE [ 1263.838789] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.838899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.838979] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.839217] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.839309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.839488] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.839595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.839659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.839818] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.839900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.840102] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.840232] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.840276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.840436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.840515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.840601] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07e722ee-52b4-4ea2-a403-342bdceeb278 is going to be updated. [ 1263.866222] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.866370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.866442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.866652] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.866844] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.867026] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07e722ee-52b4-4ea2-a403-342bdceeb278" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.342709] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.844823] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.844983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.845067] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.845292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.845384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.845497] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be updated. [ 1264.872728] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.872944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.872994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.873205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.873355] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.881981] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: IN_PROGRESS for 2s [ 1266.893449] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: SUCCESS [ 1266.893791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.893841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.894055] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.894250] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.894372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.894447] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.894611] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.894694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.894784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.894882] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.396683] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.899307] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d450c5a-e2df-45be-a358-d8fce8ee7d24: rpc.has_security_group_logging(os_id): False [ 1267.921634] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.921846] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.921900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.922193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.922297] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.922635] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.922788] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.922847] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.923021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.923110] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.923197] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be updated. [ 1267.985292] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.985503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.985577] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.985851] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.986057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.008387] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: IN_PROGRESS for 2s [ 1268.331414] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1268.331579] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1270.025772] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: SUCCESS [ 1270.026196] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.332595] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1273.332977] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1274.863140] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.863587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.863587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.863587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.863754] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.366489] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.869436] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.371863] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1276.371967] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1277.126338] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.126338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.126338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.126338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.139630] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1277.140157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.140929] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1277.175092] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.175244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.175315] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.175519] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.188932] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.189704] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1277.189787] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1277.189878] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1277.227087] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.227264] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.227385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.227551] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.228936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.229147] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1277.304661] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.304836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.304898] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.305107] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.305420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.305699] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1277.382144] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.382321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.382385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.382573] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.382927] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.383243] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1277.383358] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'3dc0cc02-0477-4365-b448-c823c1d0ff33', '6fb331de-c43a-4554-b058-e80ee9a9d039', '994aca44-3363-4f2f-9033-f0c0f6791222', '0437342b-6575-4c08-8d68-72455f1041f3', '532815ef-03c8-40fb-91ab-292fc1c769b2', '1d450c5a-e2df-45be-a358-d8fce8ee7d24', 'c4a9da48-db34-4124-bc5a-acf3f884fbec', 'bcbeb6f9-c515-4ff5-9c1f-1b944526d767', '06b41f20-e9f6-4dd0-84af-8ce8a036eff7', '110f090f-7c2e-4e86-a35e-37ed29bc880a', '959327f1-c8f9-4b93-8465-81e781bdec37', 'ddea2811-281c-4b6c-b3c2-13049eb000a4', 'c8b96c18-8a3b-48f3-8303-8b48b5735ba8', 'dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6', 'b1d9a7ff-d6e8-45b7-a6eb-87684637dd08', 'bef6eb63-26a4-4ff5-9105-ba8720b0e581', 'a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419', '803064c7-17f8-46ee-bdf3-20357514c794', 'b57d8773-fb88-48dd-8778-aad060b75558', 'f4dd1b93-af3a-481d-8833-92383b938f1f', 'b0452f9c-a0e7-4e50-8cca-d6f1c8e9b4c2', '3e3fa94e-ad64-4239-ae57-26fdc5531217', '7ae9a71f-5c96-43e4-8524-e661508c021c', 'f5345cc2-0f25-4dd2-bed5-a938bfc6e247', 'eab15f99-d56d-4017-8640-5d7acb890c08', '9debc847-a741-46fa-9447-b1070c70a885', '8fcbfb84-5d7b-4110-9dbd-3c7d4d2a967c', '2c27a619-83e9-4ab1-a7c8-d2d45bd50134', '559d2715-9b43-4a1c-ab57-3faf644a7a85', '6cdd9a71-efff-486a-bba8-192e985b48d0', 'cb8b39ac-23d5-452c-9ec6-33c3aa98d53f', '2ce7ad2e-e1d4-421e-ba1c-05cd3f659fb4', '859b640d-3815-457c-8a5b-e9eee00dbcee', '592d30d0-26f8-4498-ae9a-adafe7d95eb3', '2fdc28f1-77ed-4baf-84b4-15276bc8a55c', 'ecdef958-2ee2-4519-a11c-44b06e5f8bd6', 'a8524b03-3553-4474-98ff-53fee924a364', '0b6cb33c-9436-488b-bac4-02b8d09327a1', 'ebdff0ac-e383-4307-98b2-c7e34194e641', '543e5c7b-13a7-46c1-bdc6-6f13da8e5c1a', 'c3f4ecb4-733b-4e4f-a088-b50706c8f083', 'a948ef5d-7e31-413f-8d23-aa989234c539', '3c88a973-e953-4cb7-bda1-829fc68b91a4', 'ab04df45-cf74-4894-8e09-dc03e4e3ecab', '480fedb1-b714-4d98-8f62-8eca0ff3855e', '0602c86f-34c6-42e5-a101-35f6c95de05b'} {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1277.383463] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1277.403059] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.403213] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.403265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.403624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.403624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.403624] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1277.403732] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1277.403732] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1277.472504] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.472676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.472808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.472920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.474113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.474390] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1277.474469] env[69692]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69692) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1277.474587] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1277.474587] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1277.474696] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1277.474735] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGH for action security_group_rules [ 1277.474816] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 with Priority: HIGH for action security_group_rules [ 1277.474882] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGH for action security_group_rules [ 1277.474946] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0437342b-6575-4c08-8d68-72455f1041f3 with Priority: HIGH for action security_group_rules [ 1277.475015] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGH for action security_group_rules [ 1277.475083] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGH for action security_group_rules [ 1277.475144] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGH for action security_group_rules [ 1277.475204] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGH for action security_group_rules [ 1277.475309] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGH for action security_group_rules [ 1277.475352] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGH for action security_group_rules [ 1277.475390] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 959327f1-c8f9-4b93-8465-81e781bdec37 with Priority: HIGH for action security_group_rules [ 1277.475434] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGH for action security_group_rules [ 1277.475490] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 with Priority: HIGH for action security_group_rules [ 1277.475551] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGH for action security_group_rules [ 1277.475614] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGH for action security_group_rules [ 1277.475675] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGH for action security_group_rules [ 1277.475738] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGH for action security_group_rules [ 1277.475799] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGH for action security_group_rules [ 1277.475906] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b57d8773-fb88-48dd-8778-aad060b75558 with Priority: HIGH for action security_group_rules [ 1277.475956] env[69692]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f4dd1b93-af3a-481d-8833-92383b938f1f with Priority: HIGH for action security_group_rules [ 1277.476061] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.258447] env[69692]: INFO networking_nsxv3.common.synchronization [req-c71ef8a9-e41d-42a1-89cd-4e7543b8729c req-45b24096-8a60-4e72-a5d1-b0dc5b5bf86c tempest-ServerActionsTestJSON-532161054 tempest-ServerActionsTestJSON-532161054-project-member] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1278.258996] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1278.259329] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGH for action security_group_rules [ 1278.259329] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 994aca44-3363-4f2f-9033-f0c0f6791222 with Priority: HIGH for action security_group_rules [ 1278.259404] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4a9da48-db34-4124-bc5a-acf3f884fbec with Priority: HIGH for action security_group_rules [ 1278.259443] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 with Priority: HIGH for action security_group_rules [ 1278.259519] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4dd1b93-af3a-481d-8833-92383b938f1f with Priority: HIGH for action security_group_rules [ 1278.259673] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b57d8773-fb88-48dd-8778-aad060b75558 with Priority: HIGH for action security_group_rules [ 1278.259721] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803064c7-17f8-46ee-bdf3-20357514c794 with Priority: HIGH for action security_group_rules [ 1278.259770] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 with Priority: HIGH for action security_group_rules [ 1278.259868] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 with Priority: HIGH for action security_group_rules [ 1278.259995] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 with Priority: HIGH for action security_group_rules [ 1278.260120] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 with Priority: HIGH for action security_group_rules [ 1278.260180] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 with Priority: HIGH for action security_group_rules [ 1278.260265] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 959327f1-c8f9-4b93-8465-81e781bdec37 with Priority: HIGH for action security_group_rules [ 1278.260350] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a with Priority: HIGH for action security_group_rules [ 1278.260440] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 with Priority: HIGH for action security_group_rules [ 1278.260529] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGH for action security_group_rules [ 1278.260620] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 with Priority: HIGH for action security_group_rules [ 1278.260711] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 with Priority: HIGH for action security_group_rules [ 1278.261060] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 with Priority: HIGH for action security_group_rules [ 1278.261060] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0437342b-6575-4c08-8d68-72455f1041f3 with Priority: HIGH for action security_group_rules [ 1278.261186] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.261315] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.261377] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.261631] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.261727] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.261906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.261906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.262049] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.262111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.262195] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.263040] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.263630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.263751] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.263869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.263959] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.264696] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-994aca44-3363-4f2f-9033-f0c0f6791222 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.264805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.264865] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.265480] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.265480] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('994aca44-3363-4f2f-9033-f0c0f6791222',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.265753] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4a9da48-db34-4124-bc5a-acf3f884fbec taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.265963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.266181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.266359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.266449] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4a9da48-db34-4124-bc5a-acf3f884fbec',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.267309] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.267381] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.267426] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.267587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.267661] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1d9a7ff-d6e8-45b7-a6eb-87684637dd08',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.270288] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4dd1b93-af3a-481d-8833-92383b938f1f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.270288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.270288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.270288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.270288] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4dd1b93-af3a-481d-8833-92383b938f1f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.270288] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b57d8773-fb88-48dd-8778-aad060b75558 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.270288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.270288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.270288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.270288] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b57d8773-fb88-48dd-8778-aad060b75558',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.271073] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-803064c7-17f8-46ee-bdf3-20357514c794 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.271073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.271073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.271073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.271219] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('803064c7-17f8-46ee-bdf3-20357514c794',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.271783] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.272276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.272339] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.272495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.272568] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.273576] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.273576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.273576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.273767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.273767] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.274659] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.274752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.274823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.274975] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.275059] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bef6eb63-26a4-4ff5-9105-ba8720b0e581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.275717] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8b96c18-8a3b-48f3-8303-8b48b5735ba8 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.276086] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.276172] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.276327] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.276413] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8b96c18-8a3b-48f3-8303-8b48b5735ba8',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.277224] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddea2811-281c-4b6c-b3c2-13049eb000a4 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.277382] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.277425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.277544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.277616] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddea2811-281c-4b6c-b3c2-13049eb000a4',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.280227] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-959327f1-c8f9-4b93-8465-81e781bdec37 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.280336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.280495] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.280552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.280623] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('959327f1-c8f9-4b93-8465-81e781bdec37',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.281303] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-110f090f-7c2e-4e86-a35e-37ed29bc880a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.281430] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.281497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.281645] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.281717] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('110f090f-7c2e-4e86-a35e-37ed29bc880a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.282453] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.282559] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.282625] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.282773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.282834] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06b41f20-e9f6-4dd0-84af-8ce8a036eff7',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.283612] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.283939] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.284019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.284174] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.284846] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.284984] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.285305] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.285375] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.285799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.285902] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcbeb6f9-c515-4ff5-9c1f-1b944526d767',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.286587] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-532815ef-03c8-40fb-91ab-292fc1c769b2 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.286790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.286790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.286912] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.286969] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('532815ef-03c8-40fb-91ab-292fc1c769b2',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.287786] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fb331de-c43a-4554-b058-e80ee9a9d039 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.287897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.287965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.288159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.288244] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fb331de-c43a-4554-b058-e80ee9a9d039',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.289665] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0437342b-6575-4c08-8d68-72455f1041f3 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.289775] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.289843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.289996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.290093] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0437342b-6575-4c08-8d68-72455f1041f3',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.315757] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.315951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.316023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.316199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.321955] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.322069] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.332703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.332811] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 994aca44-3363-4f2f-9033-f0c0f6791222 is going to be deleted. [ 1278.333620] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.333822] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.355128] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.355128] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1d9a7ff-d6e8-45b7-a6eb-87684637dd08 is going to be deleted. [ 1278.388997] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.389178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.389247] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.389728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.389728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.389728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-994aca44-3363-4f2f-9033-f0c0f6791222" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.404473] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.404596] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.404696] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.404872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.404959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.405092] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1d9a7ff-d6e8-45b7-a6eb-87684637dd08" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.792856] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.793007] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.793088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.793304] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.793471] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.793574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.793636] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.793790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.793897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.793986] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.794090] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.798429] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.798502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.798502] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.798665] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.809457] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.809618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.809727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.809935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.810122] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.810225] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.810305] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.810489] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.810600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.810710] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.810808] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.817689] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.817787] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.820658] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.850227] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.850407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.858941] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.859090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.865017] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.865017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.869595] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.869702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.870416] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.870549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.871267] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.871361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.872171] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.872570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.873073] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.873152] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.873850] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.873975] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.874600] env[69692]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.875098] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.875200] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.875890] env[69692]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.876314] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.876369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.877628] env[69692]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.878108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.878348] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.878471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.878539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.878818] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.878818] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.878905] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 is going to be updated. [ 1278.880378] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.880476] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.880581] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.880705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.882258] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.882721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.882967] env[69692]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.883413] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.883505] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.884595] env[69692]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.884998] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.885110] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.900989] env[69692]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.901503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.901632] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddea2811-281c-4b6c-b3c2-13049eb000a4 is going to be deleted. [ 1278.902511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.902697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.907073] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.907197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.907266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.907431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.907561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.914959] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: IN_PROGRESS for 2s [ 1278.921540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.921659] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0437342b-6575-4c08-8d68-72455f1041f3 is going to be deleted. [ 1278.922465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.922658] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.939277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.939391] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 959327f1-c8f9-4b93-8465-81e781bdec37 is going to be deleted. [ 1278.940317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.940531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.958145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.958495] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6 is going to be deleted. [ 1278.959089] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.959301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.962474] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.962576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.978112] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.978266] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.984020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.984158] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bef6eb63-26a4-4ff5-9105-ba8720b0e581 is going to be deleted. [ 1278.985047] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.985237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.986556] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.986688] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.012033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.012190] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcbeb6f9-c515-4ff5-9c1f-1b944526d767 is going to be deleted. [ 1279.013137] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.014340] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.037275] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.037275] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8b96c18-8a3b-48f3-8303-8b48b5735ba8 is going to be deleted. [ 1279.037441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.037728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.064324] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.064452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.071341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.071341] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4a9da48-db34-4124-bc5a-acf3f884fbec is going to be deleted. [ 1279.072120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.072336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.073855] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.074011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.105183] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.105312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.140877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.141062] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 803064c7-17f8-46ee-bdf3-20357514c794 is going to be deleted. [ 1279.141982] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.142226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.165775] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.165950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.236223] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.236364] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06b41f20-e9f6-4dd0-84af-8ce8a036eff7 is going to be deleted. [ 1279.237315] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.237532] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.262739] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.262954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.266159] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.266284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.312549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.312690] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b57d8773-fb88-48dd-8778-aad060b75558 is going to be deleted. [ 1279.313806] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.314028] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.314109] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.314371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.314493] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.314601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.314666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.314827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.315311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.315311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.315311] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.315311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.315311] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.315558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.315558] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.315644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.315695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.315844] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.315954] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.316057] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.316200] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.317025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.317197] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.323261] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d450c5a-e2df-45be-a358-d8fce8ee7d24: rpc.has_security_group_logging(os_id): False [ 1279.371462] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.371630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.375137] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.375281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.376119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.376245] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 110f090f-7c2e-4e86-a35e-37ed29bc880a is going to be deleted. [ 1279.377336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.377617] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.429794] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.430030] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4dd1b93-af3a-481d-8833-92383b938f1f is going to be deleted. [ 1279.430938] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.431163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.443987] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.443987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.486195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.486324] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 532815ef-03c8-40fb-91ab-292fc1c769b2 is going to be deleted. [ 1279.487437] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.487658] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.547283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.547432] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fb331de-c43a-4554-b058-e80ee9a9d039 is going to be deleted. [ 1279.548420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.548672] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.550129] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.550237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.580989] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.581135] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419 is going to be deleted. [ 1279.581951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.582182] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.582273] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.582396] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddea2811-281c-4b6c-b3c2-13049eb000a4" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.582548] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.582706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.582785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.582894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0437342b-6575-4c08-8d68-72455f1041f3" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.583370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.583561] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.583646] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.583786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-959327f1-c8f9-4b93-8465-81e781bdec37" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.584291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.584452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.584536] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.584652] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc5db0fb-5dbe-4130-9b0e-fdb82d9963c6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.585361] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.585465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.585534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.585683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.585762] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.585919] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4dd1b93-af3a-481d-8833-92383b938f1f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.586199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.586362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.586443] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.586555] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcbeb6f9-c515-4ff5-9c1f-1b944526d767" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.586665] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.586806] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.586881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.586996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bef6eb63-26a4-4ff5-9105-ba8720b0e581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.587134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.587276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.587350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.587454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8b96c18-8a3b-48f3-8303-8b48b5735ba8" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.587562] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.587697] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.587771] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.587876] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-803064c7-17f8-46ee-bdf3-20357514c794" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.588011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.588198] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.588271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.588379] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4a9da48-db34-4124-bc5a-acf3f884fbec" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.588493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.588630] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.588704] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.588808] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06b41f20-e9f6-4dd0-84af-8ce8a036eff7" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.588933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.589086] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.610185] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.610325] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.641345] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.641639] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.641738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.641804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.641984] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.642084] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.642183] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be updated. [ 1279.643163] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.643333] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.643416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.643529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-110f090f-7c2e-4e86-a35e-37ed29bc880a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.643717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.644244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.644340] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.644455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b57d8773-fb88-48dd-8778-aad060b75558" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.644653] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.644750] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.644827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.644946] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-532815ef-03c8-40fb-91ab-292fc1c769b2" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.680943] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.681096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.681156] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.681362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.681450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.681567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fb331de-c43a-4554-b058-e80ee9a9d039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.758060] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.758248] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.758430] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.758660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.758760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.758884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8c6ead9-1dcd-4ac9-b07f-67d3a2c1d419" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.766619] env[69692]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.767191] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.767309] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.767379] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.767580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.767728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.777265] env[69692]: INFO networking_nsxv3.common.synchronization [req-6bdba499-dc45-40f9-b8a2-703359ce654c req-0b555318-82ec-4e08-b097-4a419587a4c8 tempest-ServerActionsTestOtherB-2042336296 tempest-ServerActionsTestOtherB-2042336296-project-member] Enqueued Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1279.777483] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 with Priority: HIGHEST for action security_group_members [ 1279.778056] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d450c5a-e2df-45be-a358-d8fce8ee7d24 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.778186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.778258] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.778435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.778587] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.778732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.778732] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.779372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.779372] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.779372] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d450c5a-e2df-45be-a358-d8fce8ee7d24',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.818871] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3dc0cc02-0477-4365-b448-c823c1d0ff33: rpc.has_security_group_logging(os_id): False [ 1279.834925] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: IN_PROGRESS for 2s [ 1279.927787] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.927959] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.928500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.928500] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.973097] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.973368] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.973528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.973568] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.973767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.973834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.974094] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.974204] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.974269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.974423] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.974498] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.974676] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.974770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.974823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.974967] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.975228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.975329] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 is going to be updated. [ 1280.042462] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.042591] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.042642] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.042856] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.042999] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.059482] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: IN_PROGRESS for 2s [ 1280.282569] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.282569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.282569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.283116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.283116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.283116] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.283116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.283116] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.283433] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.283433] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.283433] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 is going to be updated. [ 1280.313012] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.313012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.313012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.313012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.313012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.321686] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: IN_PROGRESS for 2s [ 1280.924438] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: SUCCESS [ 1280.924628] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 deletion is rescheduled due to dependency. [ 1280.924724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.850467] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: SUCCESS [ 1281.850819] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.074330] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: SUCCESS [ 1282.074549] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.331852] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 in Status: SUCCESS [ 1282.332010] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d450c5a-e2df-45be-a358-d8fce8ee7d24 deletion is rescheduled due to dependency. [ 1282.332134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d450c5a-e2df-45be-a358-d8fce8ee7d24" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.573464] env[69692]: INFO networking_nsxv3.common.synchronization [req-72d0f9e9-0eae-4697-b40f-03c8c3f0133a req-2e00c426-801c-406b-9a64-f03602496064 tempest-ServersNegativeTestJSON-162754182 tempest-ServersNegativeTestJSON-162754182-project-member] Enqueued Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1282.573464] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 with Priority: HIGHEST for action security_group_members [ 1282.574111] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-3dc0cc02-0477-4365-b448-c823c1d0ff33 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.574111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.574111] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.574239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.574758] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.574758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.574758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.574758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.574758] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.575027] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3dc0cc02-0477-4365-b448-c823c1d0ff33',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.077521] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.077871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.077871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.077957] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.078085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.078349] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.078452] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.078515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.078666] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.078743] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.078828] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 is going to be updated. [ 1283.105649] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.105784] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.105834] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.106054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.106199] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.115297] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: IN_PROGRESS for 2s [ 1284.555396] env[69692]: INFO networking_nsxv3.common.synchronization [req-f6eccc94-59d5-413b-ad24-955bd84eae05 req-3c1ce4fd-a469-492e-9cb4-624f20f5917d tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_members [ 1284.555947] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_members [ 1284.556253] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.556370] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.556462] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.556659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.556807] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.556907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.556975] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.557149] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.557244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.557324] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.862761] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-630 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.862969] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.863111] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.863394] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.863647] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.863803] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.863921] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.864163] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.864313] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.864522] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1284.864634] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1284.864745] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1284.864853] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1284.864962] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1284.865084] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1284.865219] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1284.882713] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1284.882886] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1284.883035] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1284.883204] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-630" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.883474] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-b5cc79a3-3be4-4e58-94a7-e30ddd757039 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.883636] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-b5cc79a3-3be4-4e58-94a7-e30ddd757039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.883756] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-b5cc79a3-3be4-4e58-94a7-e30ddd757039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.884082] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-b5cc79a3-3be4-4e58-94a7-e30ddd757039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.884235] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5cc79a3-3be4-4e58-94a7-e30ddd757039',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.059152] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.124429] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 in Status: SUCCESS [ 1285.124649] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3dc0cc02-0477-4365-b448-c823c1d0ff33 deletion is rescheduled due to dependency. [ 1285.124764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3dc0cc02-0477-4365-b448-c823c1d0ff33" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.386658] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.386913] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.387075] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.387367] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.387522] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.387679] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port b5cc79a3-3be4-4e58-94a7-e30ddd757039 not found, creating... [ 1285.387934] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.388117] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.388240] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.388457] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.388597] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.388881] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.389052] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.389172] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.389380] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.389513] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.389654] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: b5cc79a3-3be4-4e58-94a7-e30ddd757039 is going to be created. [ 1285.408503] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.408839] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.409081] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.409314] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.409552] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.409781] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-b5cc79a3-3be4-4e58-94a7-e30ddd757039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.561814] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.067337] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.067337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.067337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.067337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.067337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.067337] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 is going to be updated. [ 1286.096144] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.096144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.096144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.096144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.096144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.102710] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: IN_PROGRESS for 2s [ 1286.132553] env[69692]: INFO networking_nsxv3.common.synchronization [req-f6eccc94-59d5-413b-ad24-955bd84eae05 req-371395d3-f89f-4c7e-987e-ca432d51cd2a service nova] Enqueued Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_rules [ 1286.132553] env[69692]: INFO networking_nsxv3.common.synchronization [req-f6eccc94-59d5-413b-ad24-955bd84eae05 req-371395d3-f89f-4c7e-987e-ca432d51cd2a service nova] Enqueued Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_members [ 1286.132553] env[69692]: INFO networking_nsxv3.common.synchronization [req-f6eccc94-59d5-413b-ad24-955bd84eae05 req-371395d3-f89f-4c7e-987e-ca432d51cd2a service nova] Enqueued Resource ID: b5cc79a3-3be4-4e58-94a7-e30ddd757039 with Priority: HIGHEST for action port [ 1286.132553] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_rules [ 1286.132553] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_members [ 1286.132553] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5cc79a3-3be4-4e58-94a7-e30ddd757039 with Priority: HIGHEST for action port [ 1286.132553] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.132553] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.133286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.133584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.133776] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.134849] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.135086] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.136041] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5cc79a3-3be4-4e58-94a7-e30ddd757039 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.136041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5cc79a3-3be4-4e58-94a7-e30ddd757039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.136041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5cc79a3-3be4-4e58-94a7-e30ddd757039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.136041] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5cc79a3-3be4-4e58-94a7-e30ddd757039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.136041] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5cc79a3-3be4-4e58-94a7-e30ddd757039',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.637599] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.637887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.640015] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5cc79a3-3be4-4e58-94a7-e30ddd757039 with status ACTIVE [ 1286.640192] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.640300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.640366] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.640589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.640680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.640854] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.640949] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.641022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.641184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.641260] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.641439] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.641531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.641590] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.641727] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.641799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.641881] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5cc79a3-3be4-4e58-94a7-e30ddd757039 is going to be updated. [ 1286.661209] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.661343] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.661388] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.661539] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.661662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.661810] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5cc79a3-3be4-4e58-94a7-e30ddd757039" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.122020] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: SUCCESS [ 1288.122020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.122020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.122020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.122020] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.122020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.122020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.122020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.122020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.122020] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.624381] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.126945] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.631008] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.631200] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.631274] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.631504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.631624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.631704] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 is going to be updated. [ 1289.658330] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.658508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.658583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.658891] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.659067] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.668920] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: IN_PROGRESS for 2s [ 1290.059511] env[69692]: INFO networking_nsxv3.common.synchronization [req-055bf354-bd29-4aef-8511-5458b7b448e1 req-becb3aee-5403-4a9d-9feb-91dba4f1081c tempest-ServerActionsTestJSON-532161054 tempest-ServerActionsTestJSON-532161054-project-member] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1290.060065] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1290.060442] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.063963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.063963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.063963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.063963] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.063963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.063963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.063963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.063963] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.063963] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.368650] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.368895] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.369024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.369272] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.369586] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.369748] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.369867] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.370262] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.370441] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.370767] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1290.370913] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1290.371046] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1290.371265] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1290.371346] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1290.371388] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1290.371519] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1290.389592] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1290.389770] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1290.389915] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1290.390118] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-629" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.391434] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-acca5df4-bc21-43ab-bd4d-d79c58e77691 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.391676] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-acca5df4-bc21-43ab-bd4d-d79c58e77691" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.391810] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-acca5df4-bc21-43ab-bd4d-d79c58e77691" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.392153] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-acca5df4-bc21-43ab-bd4d-d79c58e77691" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.392522] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acca5df4-bc21-43ab-bd4d-d79c58e77691',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.565743] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.565743] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.566288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.566336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.566441] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.566640] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.566745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.566807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.567013] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.567103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.567255] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 is going to be updated. [ 1290.592583] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.592823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.592823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.593046] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.593202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.602205] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: IN_PROGRESS for 2s [ 1290.895375] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.895375] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.895375] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.895769] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.895769] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.896038] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port acca5df4-bc21-43ab-bd4d-d79c58e77691 not found, creating... [ 1290.896254] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.896470] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.896602] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.896840] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.896999] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.897379] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.897637] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.897709] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.897889] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.898040] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.898667] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: acca5df4-bc21-43ab-bd4d-d79c58e77691 is going to be created. [ 1290.916565] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.916842] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.916991] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.917483] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.917600] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.917839] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-acca5df4-bc21-43ab-bd4d-d79c58e77691" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.652838] env[69692]: INFO networking_nsxv3.common.synchronization [req-055bf354-bd29-4aef-8511-5458b7b448e1 req-57d4e444-8f38-448d-b119-04f5899918ed service nova] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_rules [ 1291.653084] env[69692]: INFO networking_nsxv3.common.synchronization [req-055bf354-bd29-4aef-8511-5458b7b448e1 req-57d4e444-8f38-448d-b119-04f5899918ed service nova] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1291.653261] env[69692]: INFO networking_nsxv3.common.synchronization [req-055bf354-bd29-4aef-8511-5458b7b448e1 req-57d4e444-8f38-448d-b119-04f5899918ed service nova] Enqueued Resource ID: acca5df4-bc21-43ab-bd4d-d79c58e77691 with Priority: HIGHEST for action port [ 1291.653512] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_rules [ 1291.653645] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1291.653740] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acca5df4-bc21-43ab-bd4d-d79c58e77691 with Priority: HIGHEST for action port [ 1291.654517] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.654620] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.654709] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.654941] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.655064] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.656034] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.656177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.656508] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-acca5df4-bc21-43ab-bd4d-d79c58e77691 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.656721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acca5df4-bc21-43ab-bd4d-d79c58e77691" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.656800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acca5df4-bc21-43ab-bd4d-d79c58e77691" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.657029] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acca5df4-bc21-43ab-bd4d-d79c58e77691" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.657149] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acca5df4-bc21-43ab-bd4d-d79c58e77691',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.679075] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: SUCCESS [ 1291.679694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.679694] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.679830] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.679984] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.680212] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.680284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.680455] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.680584] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.680707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.681152] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.159064] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.159064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.159064] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acca5df4-bc21-43ab-bd4d-d79c58e77691 with status ACTIVE [ 1292.159064] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.159328] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.159328] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.159403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.159454] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.159619] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.159716] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.159815] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.159961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.160011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.160181] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.160317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.160349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.160466] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.160541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.160623] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acca5df4-bc21-43ab-bd4d-d79c58e77691 is going to be updated. [ 1292.180270] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.180416] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.180463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.180651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.180781] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.180935] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acca5df4-bc21-43ab-bd4d-d79c58e77691" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.183253] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.610824] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: SUCCESS [ 1292.610923] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 deletion is rescheduled due to dependency. [ 1292.611052] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.611194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.611407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.611589] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.611702] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.611763] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.611912] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.611994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.612101] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.685440] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ecdef958-2ee2-4519-a11c-44b06e5f8bd6: rpc.has_security_group_logging(os_id): False [ 1292.702491] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.702711] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.702760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.703033] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.789712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.790229] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.790229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.790229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.790435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.790531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.790599] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 is going to be updated. [ 1292.843823] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.843999] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.844059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.844263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.844407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.854737] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: IN_PROGRESS for 2s [ 1293.114239] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.524032] env[69692]: INFO networking_nsxv3.common.synchronization [None req-fd82b87f-126b-4018-963f-3fd3f55e55d0 None None] Enqueued Resource ID: 5e4a94ff-f589-4ae9-8551-7cde257f43f9 with Priority: HIGHEST for action port [ 1293.524032] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e4a94ff-f589-4ae9-8551-7cde257f43f9 with Priority: HIGHEST for action port [ 1293.524032] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e4a94ff-f589-4ae9-8551-7cde257f43f9 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.524032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e4a94ff-f589-4ae9-8551-7cde257f43f9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.524032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e4a94ff-f589-4ae9-8551-7cde257f43f9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.524677] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e4a94ff-f589-4ae9-8551-7cde257f43f9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.524870] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e4a94ff-f589-4ae9-8551-7cde257f43f9',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.617432] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.027418] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e4a94ff-f589-4ae9-8551-7cde257f43f9 [ 1294.027757] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.027829] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.027881] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.028088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.028181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.028275] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e4a94ff-f589-4ae9-8551-7cde257f43f9 already deleted. [ 1294.028362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e4a94ff-f589-4ae9-8551-7cde257f43f9" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.119866] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.119866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.119866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.119866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.119866] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.119866] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 is going to be updated. [ 1294.165576] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.165576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.165576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.165576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.165576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.174774] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: IN_PROGRESS for 2s [ 1294.867456] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: SUCCESS [ 1294.867717] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.417459] env[69692]: INFO networking_nsxv3.common.synchronization [None req-016d76d5-75a0-4ebb-89d0-8b53e75c88a6 None None] Enqueued Resource ID: 62a265b1-4053-4f47-aac1-107e08e4e297 with Priority: HIGHEST for action port [ 1295.417993] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62a265b1-4053-4f47-aac1-107e08e4e297 with Priority: HIGHEST for action port [ 1295.418304] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-62a265b1-4053-4f47-aac1-107e08e4e297 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.418456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62a265b1-4053-4f47-aac1-107e08e4e297" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.418526] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62a265b1-4053-4f47-aac1-107e08e4e297" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.418791] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62a265b1-4053-4f47-aac1-107e08e4e297" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.418855] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62a265b1-4053-4f47-aac1-107e08e4e297',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.921254] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62a265b1-4053-4f47-aac1-107e08e4e297 [ 1295.921347] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.921571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.921571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.921760] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.921858] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.921948] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62a265b1-4053-4f47-aac1-107e08e4e297 already deleted. [ 1295.922036] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62a265b1-4053-4f47-aac1-107e08e4e297" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.184988] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: SUCCESS [ 1296.185352] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.185497] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.185705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.185890] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.186019] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.186113] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.186276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.186358] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.186445] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.186539] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.689022] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.192153] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c27a619-83e9-4ab1-a7c8-d2d45bd50134: rpc.has_security_group_logging(os_id): False [ 1297.210025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.210025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.210025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.210025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.210025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.210025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.210025] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.210349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.210349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.210349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.210415] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 is going to be updated. [ 1297.264723] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.264723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.264933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.264981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.265222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.275682] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: IN_PROGRESS for 2s [ 1298.737611] env[69692]: INFO networking_nsxv3.common.synchronization [req-224cdc23-a8cd-4750-a24c-70b3b589cc43 req-491c6f9b-8dc7-4770-b39d-02c828e8eb0b tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1298.738080] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1298.738384] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.738508] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.738575] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.738825] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.738974] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.739104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.739177] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.739329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.739412] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.739504] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.001019] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-375 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.001019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-375" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.001019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-375" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.001019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-375" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.001019] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.001019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.001019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.001019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.001019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.001019] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1299.001371] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1299.001371] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1299.001371] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1299.001371] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1299.001458] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1299.001590] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1299.020154] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1299.020357] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1299.020547] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1299.020778] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-375" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.022191] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-922cfd37-11c9-4736-86a7-75c9e9becae5 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.022191] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.022191] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.022540] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.022898] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('922cfd37-11c9-4736-86a7-75c9e9becae5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.242054] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.242054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.242054] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.242326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.242326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.242512] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.242613] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.242674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.242823] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.242897] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.242982] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2feafb-25d1-4903-a0a6-904941820e4a already deleted. [ 1299.243081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.287661] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: SUCCESS [ 1299.287862] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.528644] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.528894] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.529041] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.529346] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.529516] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.529681] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 922cfd37-11c9-4736-86a7-75c9e9becae5 not found, creating... [ 1299.529954] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.530136] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.530262] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.530495] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.530636] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.530971] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.531155] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.531315] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.531487] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.531626] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.531769] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 922cfd37-11c9-4736-86a7-75c9e9becae5 is going to be created. [ 1299.550551] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.550751] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.550876] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.551145] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.551378] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.551601] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.260368] env[69692]: INFO networking_nsxv3.common.synchronization [req-224cdc23-a8cd-4750-a24c-70b3b589cc43 req-b688f384-dc3e-4499-ada6-174b3bc638e8 service nova] Enqueued Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_rules [ 1300.260643] env[69692]: INFO networking_nsxv3.common.synchronization [req-224cdc23-a8cd-4750-a24c-70b3b589cc43 req-b688f384-dc3e-4499-ada6-174b3bc638e8 service nova] Enqueued Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1300.260710] env[69692]: INFO networking_nsxv3.common.synchronization [req-224cdc23-a8cd-4750-a24c-70b3b589cc43 req-b688f384-dc3e-4499-ada6-174b3bc638e8 service nova] Enqueued Resource ID: 922cfd37-11c9-4736-86a7-75c9e9becae5 with Priority: HIGHEST for action port [ 1300.260925] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_rules [ 1300.261071] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1300.261174] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 922cfd37-11c9-4736-86a7-75c9e9becae5 with Priority: HIGHEST for action port [ 1300.261761] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.261849] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.262017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.262186] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.262269] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.263087] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.263200] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.263269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.263438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.263583] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.263679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.263741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.263894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.263968] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.264138] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.265180] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-922cfd37-11c9-4736-86a7-75c9e9becae5 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.265295] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.265356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.265510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.265583] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('922cfd37-11c9-4736-86a7-75c9e9becae5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.768585] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.768585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.768585] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.768805] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 922cfd37-11c9-4736-86a7-75c9e9becae5 with status ACTIVE [ 1300.769034] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.769126] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.769210] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.769434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.769535] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.769727] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.769827] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.769887] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.770063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.770158] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.770352] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.770444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.770518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.770679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.770768] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.770848] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 922cfd37-11c9-4736-86a7-75c9e9becae5 is going to be updated. [ 1300.792203] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.792399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.792399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.792595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.792734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.792889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.273452] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.776611] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.776790] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.776865] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.777099] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.777221] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.777305] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2feafb-25d1-4903-a0a6-904941820e4a is going to be created. [ 1301.799352] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.799528] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.799654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.799817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.799981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.808560] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: UNINITIALIZED for 2s [ 1303.818641] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: SUCCESS [ 1303.818933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.819016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.819238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.819552] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.819552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.819712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.819764] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.819841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.819928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.820029] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.322017] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.322218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.322262] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.322487] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.322660] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.322753] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.322838] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.323060] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.323158] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.323255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.323446] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.323552] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.323663] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.323755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.323895] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.323998] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.324064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.324257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.324357] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.324467] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.324590] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.826746] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de2feafb-25d1-4903-a0a6-904941820e4a: rpc.has_security_group_logging(os_id): False [ 1304.843379] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.843514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.843581] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.843785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.843872] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.844057] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.844157] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.844222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.844371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.844448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.844633] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.844723] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.844782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.844919] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.844995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.845193] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.845286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.845348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.845484] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.845558] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.845642] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de2feafb-25d1-4903-a0a6-904941820e4a is going to be created. [ 1304.897176] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.897329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.897369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.897529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.897695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.908136] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: IN_PROGRESS for 2s [ 1305.262942] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.263106] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1306.921166] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: SUCCESS [ 1306.921613] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.264179] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.264522] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.265927] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.266285] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.610297] env[69692]: INFO networking_nsxv3.common.synchronization [req-1ec4a8be-ce3d-4aa7-80d7-f73c7bfb435a req-04b255a0-34ee-474b-8d57-3a273d90c3ee tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1315.610527] env[69692]: INFO networking_nsxv3.common.synchronization [req-1ec4a8be-ce3d-4aa7-80d7-f73c7bfb435a req-04b255a0-34ee-474b-8d57-3a273d90c3ee tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 with Priority: HIGHEST for action security_group_members [ 1315.611059] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1315.611196] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 with Priority: HIGHEST for action security_group_members [ 1315.611469] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.611592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.611660] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.611856] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.611999] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.612108] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.612169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.612321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.612400] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.612488] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.613294] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a0e8b6f-eaca-475a-b5c7-a485adef2849 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.613415] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.613482] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.613683] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.613823] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.613925] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.614010] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.614155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.614261] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.614351] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a0e8b6f-eaca-475a-b5c7-a485adef2849',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.656529] env[69692]: INFO networking_nsxv3.common.synchronization [req-1ec4a8be-ce3d-4aa7-80d7-f73c7bfb435a req-04b255a0-34ee-474b-8d57-3a273d90c3ee tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 with Priority: HIGHEST for action security_group_rules [ 1315.656691] env[69692]: INFO networking_nsxv3.common.synchronization [req-1ec4a8be-ce3d-4aa7-80d7-f73c7bfb435a req-04b255a0-34ee-474b-8d57-3a273d90c3ee tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 with Priority: HIGHEST for action security_group_members [ 1315.656833] env[69692]: INFO networking_nsxv3.common.synchronization [req-1ec4a8be-ce3d-4aa7-80d7-f73c7bfb435a req-04b255a0-34ee-474b-8d57-3a273d90c3ee tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_rules [ 1315.656977] env[69692]: INFO networking_nsxv3.common.synchronization [req-1ec4a8be-ce3d-4aa7-80d7-f73c7bfb435a req-04b255a0-34ee-474b-8d57-3a273d90c3ee tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1315.657120] env[69692]: INFO networking_nsxv3.common.synchronization [req-1ec4a8be-ce3d-4aa7-80d7-f73c7bfb435a req-04b255a0-34ee-474b-8d57-3a273d90c3ee tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: 922cfd37-11c9-4736-86a7-75c9e9becae5 with Priority: HIGHEST for action port [ 1315.657670] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 with Priority: HIGHEST for action security_group_rules [ 1315.657670] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_rules [ 1315.657769] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 922cfd37-11c9-4736-86a7-75c9e9becae5 with Priority: HIGHEST for action port [ 1315.657848] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 with Priority: HIGHEST for action security_group_members [ 1315.658189] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1315.658470] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a0e8b6f-eaca-475a-b5c7-a485adef2849 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.658625] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.658686] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.658923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.658995] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a0e8b6f-eaca-475a-b5c7-a485adef2849',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.659744] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.659855] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.659923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.660095] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.660168] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.660821] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-922cfd37-11c9-4736-86a7-75c9e9becae5 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.660926] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.660992] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.661179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.661253] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('922cfd37-11c9-4736-86a7-75c9e9becae5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.661903] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a0e8b6f-eaca-475a-b5c7-a485adef2849 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.661988] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.662161] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.662301] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.886939] env[69692]: INFO networking_nsxv3.common.synchronization [req-e27ceb5a-c5d9-47ab-8ab2-daa7348c3c76 req-676bc563-6d96-419d-a612-6bce3c2e4720 tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1315.886939] env[69692]: INFO networking_nsxv3.common.synchronization [req-e27ceb5a-c5d9-47ab-8ab2-daa7348c3c76 req-676bc563-6d96-419d-a612-6bce3c2e4720 tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 with Priority: HIGHEST for action security_group_members [ 1315.886939] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1315.886939] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 with Priority: HIGHEST for action security_group_members [ 1315.887141] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.887334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.887482] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a0e8b6f-eaca-475a-b5c7-a485adef2849 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.887482] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.923978] env[69692]: INFO networking_nsxv3.common.synchronization [req-e27ceb5a-c5d9-47ab-8ab2-daa7348c3c76 req-676bc563-6d96-419d-a612-6bce3c2e4720 tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_rules [ 1315.924166] env[69692]: INFO networking_nsxv3.common.synchronization [req-e27ceb5a-c5d9-47ab-8ab2-daa7348c3c76 req-676bc563-6d96-419d-a612-6bce3c2e4720 tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1315.924309] env[69692]: INFO networking_nsxv3.common.synchronization [req-e27ceb5a-c5d9-47ab-8ab2-daa7348c3c76 req-676bc563-6d96-419d-a612-6bce3c2e4720 tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: 922cfd37-11c9-4736-86a7-75c9e9becae5 with Priority: HIGHEST for action port [ 1315.924520] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_rules [ 1315.924643] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1315.924738] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 922cfd37-11c9-4736-86a7-75c9e9becae5 with Priority: HIGHEST for action port [ 1315.925218] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.925313] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.925502] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.925587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.925760] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-922cfd37-11c9-4736-86a7-75c9e9becae5 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.925840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.115917] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.116895] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a0e8b6f-eaca-475a-b5c7-a485adef2849',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.163625] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a0e8b6f-eaca-475a-b5c7-a485adef2849 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.163738] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.163913] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 922cfd37-11c9-4736-86a7-75c9e9becae5 with status ACTIVE [ 1316.164084] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.164214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.164287] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.164493] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.164585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.164755] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.164853] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.164916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.165088] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.165168] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.165375] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.165492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.165556] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.165701] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.165776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.165886] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 922cfd37-11c9-4736-86a7-75c9e9becae5 is going to be updated. [ 1316.167040] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.167141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.187630] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.188371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.188371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.188371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.188371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.188371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.188933] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.189011] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.189146] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('922cfd37-11c9-4736-86a7-75c9e9becae5',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.618211] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.619340] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a0e8b6f-eaca-475a-b5c7-a485adef2849',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.691793] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 922cfd37-11c9-4736-86a7-75c9e9becae5 with status ACTIVE [ 1316.692220] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.692331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.692331] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.692556] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.692647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.692819] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.692917] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.693120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.693183] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.693257] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.693447] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.693540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.693587] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.693730] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.693803] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.693881] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 922cfd37-11c9-4736-86a7-75c9e9becae5 is going to be updated. [ 1316.714189] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.714342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.714413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.714563] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.714691] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.714841] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-922cfd37-11c9-4736-86a7-75c9e9becae5" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.121547] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.122207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.122207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.122362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.122465] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.122589] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2feafb-25d1-4903-a0a6-904941820e4a is going to be updated. [ 1317.124305] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.124437] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.124506] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.124679] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.124761] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.124847] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 is going to be created. [ 1317.150198] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.150361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.150424] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.150622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.150770] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.157508] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.157651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.157739] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.157918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.158105] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.159964] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 in Status: UNINITIALIZED for 2s [ 1317.164821] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: IN_PROGRESS for 2s [ 1319.172090] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 in Status: SUCCESS [ 1319.172090] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.172435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.172435] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.172496] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.172597] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.172661] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.172817] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.172900] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.172993] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a0e8b6f-eaca-475a-b5c7-a485adef2849',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.174842] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: SUCCESS [ 1319.175023] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.175169] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.175334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.175678] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.175678] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.175678] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.175800] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.175884] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.175933] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.677853] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.678030] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.678098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.678288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.678398] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.678601] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.678703] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.678767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.678919] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.678996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.679098] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 is going to be deleted. [ 1319.680179] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.713056] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.713161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.713222] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.713425] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.713518] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.713616] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.713757] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.713908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.714077] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.714178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.714239] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.714385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.714463] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.714555] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a0e8b6f-eaca-475a-b5c7-a485adef2849',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.185393] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.216801] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.216970] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.217050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.217265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.217360] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.217545] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.217644] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.217708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.217857] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.217947] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.218048] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 already deleted. [ 1320.218130] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.218271] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.218413] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.218554] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.218647] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.218707] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.218842] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.218915] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.219008] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a0e8b6f-eaca-475a-b5c7-a485adef2849',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.687673] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.687836] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.687912] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.688159] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.688259] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.688362] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2feafb-25d1-4903-a0a6-904941820e4a is going to be updated. [ 1320.715299] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.715427] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.715504] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.715695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.715839] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.720438] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.720554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.720622] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.720799] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.721626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.721626] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.721626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.721626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.721626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.721626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.721626] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 already deleted. [ 1320.721626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.721952] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a0e8b6f-eaca-475a-b5c7-a485adef2849',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.724231] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: IN_PROGRESS for 2s [ 1320.825784] env[69692]: INFO networking_nsxv3.common.synchronization [req-b40f12b8-15ff-440f-8743-fb7d4bc1276d req-a55275f0-9d0a-4cb5-938e-71679ccbcfbe tempest-ServerRescueTestJSONUnderV235-1150569463 tempest-ServerRescueTestJSONUnderV235-1150569463-project-member] Enqueued Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1320.826345] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2feafb-25d1-4903-a0a6-904941820e4a with Priority: HIGHEST for action security_group_members [ 1320.826648] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2feafb-25d1-4903-a0a6-904941820e4a taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.826752] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.224958] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a0e8b6f-eaca-475a-b5c7-a485adef2849',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.726845] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a0e8b6f-eaca-475a-b5c7-a485adef2849: rpc.has_security_group_logging(os_id): False [ 1321.747025] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.747193] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.747302] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.747540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.747659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.747887] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.748017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.748098] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.748284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.748387] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.748496] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 is going to be created. [ 1321.763305] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/7a0e8b6f-eaca-475a-b5c7-a485adef2849], does not exist path=[/infra/domains/default/groups/7a0e8b6f-eaca-475a-b5c7-a485adef2849]."\n}' [ 1321.763406] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7a0e8b6f-eaca-475a-b5c7-a485adef2849 [ 1321.763484] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1321.792135] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.792319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.792319] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.792523] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.793276] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.793516] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.793623] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.793687] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.793843] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.793909] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.794085] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.794195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.794250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.794391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.794462] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.794547] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a0e8b6f-eaca-475a-b5c7-a485adef2849 is going to be created. [ 1321.808464] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/7a0e8b6f-eaca-475a-b5c7-a485adef2849], does not exist path=[/infra/domains/default/groups/7a0e8b6f-eaca-475a-b5c7-a485adef2849]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7a0e8b6f-eaca-475a-b5c7-a485adef2849 [ 1321.808585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a0e8b6f-eaca-475a-b5c7-a485adef2849" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.808780] env[69692]: Traceback (most recent call last): [ 1321.808818] env[69692]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1321.808818] env[69692]: return func(*args, **kwargs) [ 1321.808818] env[69692]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1321.808818] env[69692]: res.raise_for_status() [ 1321.808818] env[69692]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1321.808818] env[69692]: raise HTTPError(http_error_msg, response=self) [ 1321.808818] env[69692]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7a0e8b6f-eaca-475a-b5c7-a485adef2849 [ 1321.808818] env[69692]: During handling of the above exception, another exception occurred: [ 1321.808818] env[69692]: Traceback (most recent call last): [ 1321.809044] env[69692]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1321.809044] env[69692]: listener.cb(fileno) [ 1321.809044] env[69692]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1321.809044] env[69692]: result = function(*args, **kwargs) [ 1321.809044] env[69692]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1321.809044] env[69692]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1321.809044] env[69692]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1321.809044] env[69692]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1321.809044] env[69692]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1321.809044] env[69692]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1321.809044] env[69692]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1321.809044] env[69692]: res.raise_for_status() [ 1321.809044] env[69692]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1321.809044] env[69692]: raise HTTPError(http_error_msg, response=self) [ 1321.809044] env[69692]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/7a0e8b6f-eaca-475a-b5c7-a485adef2849 [ 1321.809044] env[69692]: Removing descriptor: 61 [ 1322.733733] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: SUCCESS [ 1322.734082] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.734220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.734348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.734531] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.734693] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.734796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.734867] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.734950] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.735058] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.237856] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.238012] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.238063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.238362] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.257567] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.257811] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.257970] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.258056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.258226] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.258307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.258397] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2feafb-25d1-4903-a0a6-904941820e4a is going to be updated. [ 1323.281971] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.282118] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.282155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.282316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.282442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.289496] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: IN_PROGRESS for 2s [ 1325.301214] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: SUCCESS [ 1325.301214] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2feafb-25d1-4903-a0a6-904941820e4a deletion is rescheduled due to dependency. [ 1325.301214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.301214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.302332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.302332] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.302332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.302332] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.302524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.302524] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.302628] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.806053] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.806053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.806053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.806053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.806053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.806053] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.806420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.806420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.806420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.806420] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.806523] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2feafb-25d1-4903-a0a6-904941820e4a is going to be updated. [ 1325.827106] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1325.827235] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1325.829093] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.829243] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.829361] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.829877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.829877] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.838788] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: IN_PROGRESS for 2s [ 1327.849425] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: SUCCESS [ 1327.849754] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2feafb-25d1-4903-a0a6-904941820e4a deletion is rescheduled due to dependency. [ 1327.849754] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.849899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.850087] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.850278] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.850389] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.850458] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.850618] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.850699] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.850783] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.850882] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.851789] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.851961] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.852127] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.852229] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.852293] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.852434] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.852511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.852597] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.354540] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.357362] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.357564] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.357595] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.357807] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.357899] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.358103] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.358202] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.358263] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.358410] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.358494] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.358582] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2feafb-25d1-4903-a0a6-904941820e4a is going to be updated. [ 1328.383403] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.383538] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.383609] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.383796] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.383929] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.399385] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: IN_PROGRESS for 2s [ 1328.856909] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de2feafb-25d1-4903-a0a6-904941820e4a: rpc.has_security_group_logging(os_id): False [ 1328.873911] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.874093] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.874132] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.874324] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.874431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.874622] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.874720] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.874782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.874936] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.875027] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.875113] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de2feafb-25d1-4903-a0a6-904941820e4a is going to be updated. [ 1328.926852] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.927022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.927063] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.927214] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.927336] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.938832] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: IN_PROGRESS for 2s [ 1330.408553] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: SUCCESS [ 1330.408902] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2feafb-25d1-4903-a0a6-904941820e4a deletion is rescheduled due to dependency. [ 1330.408902] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.828232] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.828459] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1330.951683] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de2feafb-25d1-4903-a0a6-904941820e4a in Status: SUCCESS [ 1330.951889] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.952067] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.952286] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.952376] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de2feafb-25d1-4903-a0a6-904941820e4a',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.472699] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.473121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.473121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.473121] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.488772] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.488899] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de2feafb-25d1-4903-a0a6-904941820e4a is going to be deleted. [ 1331.527081] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.527234] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.527277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.527446] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.527525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.527621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de2feafb-25d1-4903-a0a6-904941820e4a" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.829524] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.829922] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.830848] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.830848] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.832615] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.832615] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.833917] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.834216] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1351.441241] env[69692]: INFO networking_nsxv3.common.synchronization [req-8720f5df-7727-490b-9080-1568a945897b req-4f642286-dd99-4c28-9023-46033abe67c2 tempest-ServerActionsTestJSON-532161054 tempest-ServerActionsTestJSON-532161054-project-member] Enqueued Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1351.441751] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 with Priority: HIGHEST for action security_group_members [ 1351.442061] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.442184] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.442251] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.442447] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.442597] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.442695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.442826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.442914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.442969] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.443100] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c27a619-83e9-4ab1-a7c8-d2d45bd50134',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.945356] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.945721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.945721] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.945792] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.967976] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.968199] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.968314] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.968379] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.968570] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.968657] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.968750] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 is going to be updated. [ 1351.994909] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.995051] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.995124] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.995308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.995444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.003512] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: IN_PROGRESS for 2s [ 1354.013910] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 in Status: SUCCESS [ 1354.014471] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c27a619-83e9-4ab1-a7c8-d2d45bd50134 deletion is rescheduled due to dependency. [ 1354.014471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c27a619-83e9-4ab1-a7c8-d2d45bd50134" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.497464] env[69692]: INFO networking_nsxv3.common.synchronization [req-94f83ba3-0547-4588-9b6f-56c9f3957095 req-2d4ebcd1-b3a9-4304-b16b-18f864621bf0 tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_members [ 1354.498017] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_members [ 1354.498805] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.498805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.498805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.498805] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.498805] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.499059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.499059] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.499110] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.499144] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.499243] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.002446] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.505532] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.008012] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.008194] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.008265] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.008592] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.008773] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.008958] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 is going to be updated. [ 1356.035192] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.035341] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.035401] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.035695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.035920] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.044503] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: IN_PROGRESS for 2s [ 1358.055224] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: SUCCESS [ 1358.055560] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.105298] env[69692]: INFO networking_nsxv3.common.synchronization [None req-5a87b51c-066e-4af8-b618-899445cdecab None None] Enqueued Resource ID: 60fa01d8-3f61-4252-9569-1dfd1488d065 with Priority: HIGHEST for action port [ 1359.105561] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60fa01d8-3f61-4252-9569-1dfd1488d065 with Priority: HIGHEST for action port [ 1359.106142] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-60fa01d8-3f61-4252-9569-1dfd1488d065 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.106283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60fa01d8-3f61-4252-9569-1dfd1488d065" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.106334] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60fa01d8-3f61-4252-9569-1dfd1488d065" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.106601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60fa01d8-3f61-4252-9569-1dfd1488d065" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.106739] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60fa01d8-3f61-4252-9569-1dfd1488d065',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.608602] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60fa01d8-3f61-4252-9569-1dfd1488d065 [ 1359.608841] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.608990] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.609081] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.609300] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.609391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.609490] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60fa01d8-3f61-4252-9569-1dfd1488d065 already deleted. [ 1359.609572] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60fa01d8-3f61-4252-9569-1dfd1488d065" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.972479] env[69692]: INFO networking_nsxv3.common.synchronization [None req-d5befc31-294a-4637-9daf-bea50c10ee37 None None] Enqueued Resource ID: 0eaa0ba6-5e5a-461f-bcaa-f768961d6dd0 with Priority: HIGHEST for action port [ 1360.973159] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eaa0ba6-5e5a-461f-bcaa-f768961d6dd0 with Priority: HIGHEST for action port [ 1360.973664] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eaa0ba6-5e5a-461f-bcaa-f768961d6dd0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.973896] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eaa0ba6-5e5a-461f-bcaa-f768961d6dd0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.973951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eaa0ba6-5e5a-461f-bcaa-f768961d6dd0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.974350] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eaa0ba6-5e5a-461f-bcaa-f768961d6dd0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.974480] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eaa0ba6-5e5a-461f-bcaa-f768961d6dd0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.478621] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0eaa0ba6-5e5a-461f-bcaa-f768961d6dd0 [ 1361.478853] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.478987] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.479073] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.479302] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.479392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.479489] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0eaa0ba6-5e5a-461f-bcaa-f768961d6dd0 already deleted. [ 1361.479569] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eaa0ba6-5e5a-461f-bcaa-f768961d6dd0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.974396] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.974396] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.107374] env[69692]: INFO networking_nsxv3.common.synchronization [req-0634fe15-b1df-430b-9a6a-ce5a539c21f6 req-dbe690cc-333e-44e0-bc03-b41d4a91de8f tempest-ServerRescueTestJSON-453409642 tempest-ServerRescueTestJSON-453409642-project-member] Enqueued Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_members [ 1366.107374] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_members [ 1366.107374] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.107374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.107374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.107374] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.107811] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.107811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.107811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.107811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.107811] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.108088] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.346546] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.346782] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-808" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.346928] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-808" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.347288] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-808" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.347558] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.347722] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.347865] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.348105] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.348261] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.348489] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1366.348606] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1366.348715] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1366.348826] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1366.348940] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1366.349057] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1366.349195] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1366.369742] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1366.369890] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1366.370048] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1366.370225] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-808" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.370502] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-472b66ed-a7e2-4c6e-9dc3-3117e6475581 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.370688] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-472b66ed-a7e2-4c6e-9dc3-3117e6475581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.370791] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-472b66ed-a7e2-4c6e-9dc3-3117e6475581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.371102] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-472b66ed-a7e2-4c6e-9dc3-3117e6475581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.371246] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('472b66ed-a7e2-4c6e-9dc3-3117e6475581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.610167] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.610290] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.610385] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.610574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.610664] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.610857] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.610952] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.611040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.611205] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.611283] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.611371] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5a27c39-6a74-49af-904d-9ad757735e77 already deleted. [ 1366.611448] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.873099] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.873371] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.873441] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.873796] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.873897] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.874030] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 472b66ed-a7e2-4c6e-9dc3-3117e6475581 not found, creating... [ 1366.874299] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.874459] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.874579] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.874800] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.874941] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.875247] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.875408] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.875529] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.875738] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.875876] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.876029] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 472b66ed-a7e2-4c6e-9dc3-3117e6475581 is going to be created. [ 1366.894852] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.895075] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.895184] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.895414] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.895641] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.895850] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-472b66ed-a7e2-4c6e-9dc3-3117e6475581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.572418] env[69692]: INFO networking_nsxv3.common.synchronization [req-0634fe15-b1df-430b-9a6a-ce5a539c21f6 req-f9a24c4f-2366-426d-a788-728c3c3417b6 service nova] Enqueued Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_rules [ 1367.572692] env[69692]: INFO networking_nsxv3.common.synchronization [req-0634fe15-b1df-430b-9a6a-ce5a539c21f6 req-f9a24c4f-2366-426d-a788-728c3c3417b6 service nova] Enqueued Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_members [ 1367.572800] env[69692]: INFO networking_nsxv3.common.synchronization [req-0634fe15-b1df-430b-9a6a-ce5a539c21f6 req-f9a24c4f-2366-426d-a788-728c3c3417b6 service nova] Enqueued Resource ID: 472b66ed-a7e2-4c6e-9dc3-3117e6475581 with Priority: HIGHEST for action port [ 1367.572969] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_rules [ 1367.573185] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_members [ 1367.573309] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472b66ed-a7e2-4c6e-9dc3-3117e6475581 with Priority: HIGHEST for action port [ 1367.573857] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.573983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.574056] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.574307] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.574392] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.575195] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.575299] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.575367] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.575529] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.575675] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.575769] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.575832] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.575970] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.576064] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.576168] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.577215] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-472b66ed-a7e2-4c6e-9dc3-3117e6475581 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.577323] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-472b66ed-a7e2-4c6e-9dc3-3117e6475581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.577392] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-472b66ed-a7e2-4c6e-9dc3-3117e6475581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.577541] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-472b66ed-a7e2-4c6e-9dc3-3117e6475581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.577614] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('472b66ed-a7e2-4c6e-9dc3-3117e6475581',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.079437] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.079662] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.079784] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.080625] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 472b66ed-a7e2-4c6e-9dc3-3117e6475581 with status ACTIVE [ 1368.080805] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.080919] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.080989] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.081219] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.081310] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.081481] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.081580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.081643] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.081804] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.081885] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.082078] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.082175] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.082238] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.082380] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.082456] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.082538] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 472b66ed-a7e2-4c6e-9dc3-3117e6475581 is going to be updated. [ 1368.101099] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.101230] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.101330] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.101451] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.101580] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.101743] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-472b66ed-a7e2-4c6e-9dc3-3117e6475581" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.584848] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.905800] env[69692]: INFO networking_nsxv3.common.synchronization [req-06dcb94f-4673-4953-8875-07a72f02b0fe req-93a59749-d2fc-4135-9f73-c06f443a9975 tempest-ServerActionsTestOtherA-1697390537 tempest-ServerActionsTestOtherA-1697390537-project-member] Enqueued Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_members [ 1368.905800] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 with Priority: HIGHEST for action security_group_members [ 1368.906230] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.906391] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.906484] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.906712] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.907208] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.907208] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.907208] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.907431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.907431] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.907522] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecdef958-2ee2-4519-a11c-44b06e5f8bd6',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.087032] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.087312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.087312] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.087491] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.087588] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.087685] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5a27c39-6a74-49af-904d-9ad757735e77 is going to be created. [ 1369.117320] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.117545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.117545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.117690] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.117846] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.126393] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: UNINITIALIZED for 2s [ 1369.409605] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.409869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.409869] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.410138] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.430020] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.430260] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.430371] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.430442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.430626] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.430700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.430787] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 is going to be updated. [ 1369.452177] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.452330] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.452369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.452537] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.452667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.460608] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: IN_PROGRESS for 2s [ 1371.135069] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: UNINITIALIZED for 4s [ 1371.469986] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 in Status: SUCCESS [ 1371.470212] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecdef958-2ee2-4519-a11c-44b06e5f8bd6 deletion is rescheduled due to dependency. [ 1371.470308] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecdef958-2ee2-4519-a11c-44b06e5f8bd6" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.144474] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: SUCCESS [ 1373.144736] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.144914] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.145181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.145435] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.145756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.145756] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.145828] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.145894] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.146700] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.146700] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.650858] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.651043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.651123] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.651342] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.651507] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.651632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.651682] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.651813] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.651917] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.652031] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.652183] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.652277] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.652338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.652478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.652615] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.652706] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.652767] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.652907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.652981] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.653072] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.653163] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.906635] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.906754] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1374.154909] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5a27c39-6a74-49af-904d-9ad757735e77: rpc.has_security_group_logging(os_id): False [ 1374.173705] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.173705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.173705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.173705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.173930] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.173930] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.174050] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.174083] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.174237] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.174316] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.174507] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.174602] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.174664] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.174826] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.174917] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.175095] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.175291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.175291] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.175399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.175442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.175530] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5a27c39-6a74-49af-904d-9ad757735e77 is going to be created. [ 1374.232040] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.232198] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.232249] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.232471] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.232652] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.244853] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: IN_PROGRESS for 2s [ 1376.258015] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: SUCCESS [ 1376.258268] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.735454] env[69692]: INFO networking_nsxv3.common.synchronization [None req-56a5ecf9-97c1-4fdb-be1d-7e1dc8fb46fc None None] Enqueued Resource ID: 7e94e355-031f-4408-a99d-fe125078de2f with Priority: HIGHEST for action port [ 1376.735640] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e94e355-031f-4408-a99d-fe125078de2f with Priority: HIGHEST for action port [ 1376.736417] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e94e355-031f-4408-a99d-fe125078de2f taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.736417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e94e355-031f-4408-a99d-fe125078de2f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.736417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e94e355-031f-4408-a99d-fe125078de2f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.737321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e94e355-031f-4408-a99d-fe125078de2f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.737321] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e94e355-031f-4408-a99d-fe125078de2f',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.238957] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e94e355-031f-4408-a99d-fe125078de2f [ 1377.239835] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.239835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.239835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.239835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.239835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.239835] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e94e355-031f-4408-a99d-fe125078de2f already deleted. [ 1377.240155] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e94e355-031f-4408-a99d-fe125078de2f" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.448261] env[69692]: INFO networking_nsxv3.common.synchronization [None req-c0e2896f-4cc2-4757-a660-e0bcc7b9a289 None None] Enqueued Resource ID: 31565fe1-77bd-4753-bf96-82fa0f37b23c with Priority: HIGHEST for action port [ 1378.448776] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31565fe1-77bd-4753-bf96-82fa0f37b23c with Priority: HIGHEST for action port [ 1378.449171] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-31565fe1-77bd-4753-bf96-82fa0f37b23c taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.449297] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31565fe1-77bd-4753-bf96-82fa0f37b23c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.449365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31565fe1-77bd-4753-bf96-82fa0f37b23c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.449613] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31565fe1-77bd-4753-bf96-82fa0f37b23c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.449695] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31565fe1-77bd-4753-bf96-82fa0f37b23c',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.952022] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31565fe1-77bd-4753-bf96-82fa0f37b23c [ 1378.952022] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.952022] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.952203] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.952284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.952403] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.952478] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31565fe1-77bd-4753-bf96-82fa0f37b23c already deleted. [ 1378.952540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31565fe1-77bd-4753-bf96-82fa0f37b23c" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.336146] env[69692]: INFO networking_nsxv3.common.synchronization [req-53617e5a-72cc-4d84-83c2-c1ccaf758318 req-dbc258f0-bb4c-4bc6-b2fe-fbebbfcba35d tempest-ServerMetadataNegativeTestJSON-1269600075 tempest-ServerMetadataNegativeTestJSON-1269600075-project-member] Enqueued Resource ID: 1a881cc4-1951-445b-9992-f38899556d68 with Priority: HIGHEST for action security_group_members [ 1382.336800] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a881cc4-1951-445b-9992-f38899556d68 with Priority: HIGHEST for action security_group_members [ 1382.337264] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a881cc4-1951-445b-9992-f38899556d68 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.337430] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.337544] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.338153] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.338153] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.338275] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.338356] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.338600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.339303] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.339303] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a881cc4-1951-445b-9992-f38899556d68',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.625308] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-262 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.625440] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-262" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.625654] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-262" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.625980] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-262" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.626311] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.626539] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.626719] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.627019] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.627217] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.627444] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1382.627564] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1382.627676] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1382.627789] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1382.627908] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1382.628051] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1382.628193] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1382.652294] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1382.652483] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1382.652665] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1382.652889] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-262" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.653266] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-fc7ac9a4-b476-4f3f-ab71-723b107bb82e taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.653474] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-fc7ac9a4-b476-4f3f-ab71-723b107bb82e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.653617] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-fc7ac9a4-b476-4f3f-ab71-723b107bb82e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.653990] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-fc7ac9a4-b476-4f3f-ab71-723b107bb82e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.654163] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc7ac9a4-b476-4f3f-ab71-723b107bb82e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.840831] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.840999] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.841503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.841503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.841503] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.841660] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.841745] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.841809] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.841951] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.842044] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.842147] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a881cc4-1951-445b-9992-f38899556d68 already deleted. [ 1382.842228] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.156479] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.156708] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.156844] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.157207] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.157367] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.157528] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port fc7ac9a4-b476-4f3f-ab71-723b107bb82e not found, creating... [ 1383.157794] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.157968] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.158086] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.158311] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.158451] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.158731] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.158890] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.159027] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.159238] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.159395] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.159543] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: fc7ac9a4-b476-4f3f-ab71-723b107bb82e is going to be created. [ 1383.179170] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.179392] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.179526] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.179773] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.180010] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.180232] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-fc7ac9a4-b476-4f3f-ab71-723b107bb82e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.365706] env[69692]: INFO networking_nsxv3.common.synchronization [req-53617e5a-72cc-4d84-83c2-c1ccaf758318 req-7495d8bd-ad0f-4c47-8741-bc7acfa4f9a3 service nova] Enqueued Resource ID: 1a881cc4-1951-445b-9992-f38899556d68 with Priority: HIGHEST for action security_group_rules [ 1384.365934] env[69692]: INFO networking_nsxv3.common.synchronization [req-53617e5a-72cc-4d84-83c2-c1ccaf758318 req-7495d8bd-ad0f-4c47-8741-bc7acfa4f9a3 service nova] Enqueued Resource ID: 1a881cc4-1951-445b-9992-f38899556d68 with Priority: HIGHEST for action security_group_members [ 1384.366042] env[69692]: INFO networking_nsxv3.common.synchronization [req-53617e5a-72cc-4d84-83c2-c1ccaf758318 req-7495d8bd-ad0f-4c47-8741-bc7acfa4f9a3 service nova] Enqueued Resource ID: fc7ac9a4-b476-4f3f-ab71-723b107bb82e with Priority: HIGHEST for action port [ 1384.366267] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a881cc4-1951-445b-9992-f38899556d68 with Priority: HIGHEST for action security_group_rules [ 1384.366400] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a881cc4-1951-445b-9992-f38899556d68 with Priority: HIGHEST for action security_group_members [ 1384.366496] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc7ac9a4-b476-4f3f-ab71-723b107bb82e with Priority: HIGHEST for action port [ 1384.367084] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a881cc4-1951-445b-9992-f38899556d68 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.367272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.367272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.367534] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.367619] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a881cc4-1951-445b-9992-f38899556d68',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.368446] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a881cc4-1951-445b-9992-f38899556d68 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.368557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.368625] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.368786] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.368933] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.369053] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.369104] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.369288] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.369317] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.369407] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a881cc4-1951-445b-9992-f38899556d68',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.370099] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc7ac9a4-b476-4f3f-ab71-723b107bb82e taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.370207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc7ac9a4-b476-4f3f-ab71-723b107bb82e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.370272] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc7ac9a4-b476-4f3f-ab71-723b107bb82e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.370574] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc7ac9a4-b476-4f3f-ab71-723b107bb82e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.370574] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc7ac9a4-b476-4f3f-ab71-723b107bb82e',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.873051] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a881cc4-1951-445b-9992-f38899556d68',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.873875] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a881cc4-1951-445b-9992-f38899556d68 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.873991] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.875552] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc7ac9a4-b476-4f3f-ab71-723b107bb82e with status ACTIVE [ 1384.875780] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.875918] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.875994] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.876244] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.876335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.876527] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.876652] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.876724] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.876907] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.877021] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.877238] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.877349] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.877422] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.877585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.877674] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.877758] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc7ac9a4-b476-4f3f-ab71-723b107bb82e is going to be updated. [ 1384.898021] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.898179] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.898255] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.898450] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.898601] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.898766] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc7ac9a4-b476-4f3f-ab71-723b107bb82e" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.375268] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a881cc4-1951-445b-9992-f38899556d68',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.877768] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.877964] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.878043] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.878231] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.878321] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.878421] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a881cc4-1951-445b-9992-f38899556d68 is going to be created. [ 1385.901973] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.902149] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.902195] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.902346] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.902490] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.910426] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a881cc4-1951-445b-9992-f38899556d68 in Status: UNINITIALIZED for 2s [ 1387.921077] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a881cc4-1951-445b-9992-f38899556d68 in Status: SUCCESS [ 1387.921077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.921077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.921077] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.921545] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.921545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.921545] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.921776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.921776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.921776] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.921909] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a881cc4-1951-445b-9992-f38899556d68',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.287740] env[69692]: INFO networking_nsxv3.common.synchronization [req-54088032-0023-47c0-98bc-16ace95cca10 req-1077ff93-63c5-4039-acba-754e20163905 tempest-ServerRescueTestJSON-453409642 tempest-ServerRescueTestJSON-453409642-project-member] Enqueued Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_members [ 1388.288227] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_members [ 1388.288547] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.288651] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.288705] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.288906] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.289069] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.289161] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.289218] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.289396] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.289478] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.289572] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.423919] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a881cc4-1951-445b-9992-f38899556d68 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.424134] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.424178] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.424395] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.424565] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.424667] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.424733] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.424908] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.424995] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.425096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.425243] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a881cc4-1951-445b-9992-f38899556d68 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.425337] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.425399] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.425540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.425704] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.425785] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.425831] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.425953] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.426038] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.426120] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.426211] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a881cc4-1951-445b-9992-f38899556d68',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.738167] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.738385] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "network-808" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.738515] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "network-808" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.738789] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "network-808" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.739448] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.739626] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.739752] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.739979] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.740190] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.740437] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1388.740561] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] NeedRegenerationException {{(pid=69692) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1388.740675] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] no value, waiting for create lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1388.740786] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] value creation lock acquired {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1388.740901] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] No value present for key: 'zone-id' {{(pid=69692) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1388.741025] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Calling creation function for not-yet-present value {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1388.741166] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1388.759913] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1388.760076] env[69692]: DEBUG dogpile.cache.region [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69692) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1388.760219] env[69692]: DEBUG dogpile.lock [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Released creation lock {{(pid=69692) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1388.760382] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "network-808" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.760646] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock port-243e70db-4195-4d12-aa90-f2e73486f5d0 taken with stack trace [, , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.760806] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "port-243e70db-4195-4d12-aa90-f2e73486f5d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.760927] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "port-243e70db-4195-4d12-aa90-f2e73486f5d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.761224] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "port-243e70db-4195-4d12-aa90-f2e73486f5d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.761368] env[69692]: DEBUG networking_nsxv3.api.rpc [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('243e70db-4195-4d12-aa90-f2e73486f5d0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.791234] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.928594] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a881cc4-1951-445b-9992-f38899556d68: rpc.has_security_group_logging(os_id): False [ 1388.945727] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.945956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.945956] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.946165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.946267] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.946466] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.946588] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.946680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.946878] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.947037] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.947257] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.947365] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.947437] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.947583] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.947695] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.947920] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.948034] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.948103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.948250] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.948326] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.948413] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a881cc4-1951-445b-9992-f38899556d68 is going to be created. [ 1389.001262] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.001512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.001512] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.001744] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.001871] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.013306] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a881cc4-1951-445b-9992-f38899556d68 in Status: IN_PROGRESS for 2s [ 1389.264064] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.264259] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.264372] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.264674] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.264889] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.265093] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Segment Port 243e70db-4195-4d12-aa90-f2e73486f5d0 not found, creating... [ 1389.265363] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.265522] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.265643] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.265872] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.266024] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.266318] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.266469] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.266586] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.266793] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.266932] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.267111] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Resource: SegmentPort with ID: 243e70db-4195-4d12-aa90-f2e73486f5d0 is going to be created. [ 1389.286775] env[69692]: DEBUG networking_nsxv3.common.locking [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.286943] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.287108] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.287363] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.287579] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.287792] env[69692]: DEBUG oslo_concurrency.lockutils [None req-a193c3e5-92f0-4d9e-bb5d-cd9fe5bd81a6 None None] Releasing lock "port-243e70db-4195-4d12-aa90-f2e73486f5d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.295194] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.797816] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.797816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.797816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.797816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.797816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.797816] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5a27c39-6a74-49af-904d-9ad757735e77 is going to be updated. [ 1389.823147] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.823284] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.823354] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.823612] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.823782] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.833243] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: IN_PROGRESS for 2s [ 1389.952175] env[69692]: INFO networking_nsxv3.common.synchronization [req-54088032-0023-47c0-98bc-16ace95cca10 req-b23c1fe2-a81a-4cb7-9382-57a5f5ac1781 service nova] Enqueued Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_rules [ 1389.952521] env[69692]: INFO networking_nsxv3.common.synchronization [req-54088032-0023-47c0-98bc-16ace95cca10 req-b23c1fe2-a81a-4cb7-9382-57a5f5ac1781 service nova] Enqueued Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_members [ 1389.952664] env[69692]: INFO networking_nsxv3.common.synchronization [req-54088032-0023-47c0-98bc-16ace95cca10 req-b23c1fe2-a81a-4cb7-9382-57a5f5ac1781 service nova] Enqueued Resource ID: 243e70db-4195-4d12-aa90-f2e73486f5d0 with Priority: HIGHEST for action port [ 1389.952813] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_rules [ 1389.952894] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_members [ 1389.952992] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 243e70db-4195-4d12-aa90-f2e73486f5d0 with Priority: HIGHEST for action port [ 1389.953531] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.953654] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.953734] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.953916] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.953998] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.956850] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.956850] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.956850] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock port-243e70db-4195-4d12-aa90-f2e73486f5d0 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.956850] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-243e70db-4195-4d12-aa90-f2e73486f5d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.956850] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-243e70db-4195-4d12-aa90-f2e73486f5d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.956850] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-243e70db-4195-4d12-aa90-f2e73486f5d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.956850] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('243e70db-4195-4d12-aa90-f2e73486f5d0',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.458119] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.458119] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.458362] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 243e70db-4195-4d12-aa90-f2e73486f5d0 with status ACTIVE [ 1390.458394] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.458515] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.458600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.458840] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.458944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.459146] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.459269] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.459338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.459531] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.459614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.459818] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.459923] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.460010] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.460181] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.460275] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.460872] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 243e70db-4195-4d12-aa90-f2e73486f5d0 is going to be updated. [ 1390.481187] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.481335] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.481442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.481624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.481755] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.481915] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-243e70db-4195-4d12-aa90-f2e73486f5d0" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.024659] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a881cc4-1951-445b-9992-f38899556d68 in Status: SUCCESS [ 1391.024928] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.842309] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: SUCCESS [ 1391.842617] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.842737] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.842983] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.843221] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.843359] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.843432] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.843614] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.843722] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.843820] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.346228] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.848571] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.351091] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.351554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.351554] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.351624] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.351684] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.351782] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5a27c39-6a74-49af-904d-9ad757735e77 is going to be updated. [ 1393.378522] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.378733] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.378733] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.378904] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.379058] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.386687] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: IN_PROGRESS for 2s [ 1394.954424] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1394.954826] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1395.295448] env[69692]: INFO networking_nsxv3.common.synchronization [req-d18cb927-9030-40c0-ad20-3323a711a1ce req-e14374ff-e283-4d90-be9b-87f921ae8cd1 tempest-ServerMetadataNegativeTestJSON-1269600075 tempest-ServerMetadataNegativeTestJSON-1269600075-project-member] Enqueued Resource ID: 1a881cc4-1951-445b-9992-f38899556d68 with Priority: HIGHEST for action security_group_members [ 1395.297180] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a881cc4-1951-445b-9992-f38899556d68 with Priority: HIGHEST for action security_group_members [ 1395.297507] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a881cc4-1951-445b-9992-f38899556d68 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.297634] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.297708] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.298170] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.298170] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.298281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.298281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.298407] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.298492] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.298587] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a881cc4-1951-445b-9992-f38899556d68',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.397083] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: SUCCESS [ 1395.397373] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.397582] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.397835] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.398110] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.398292] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.398397] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.398600] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.398728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.398895] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.398991] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.800822] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.801017] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.801236] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.801548] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.801628] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.801850] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.801996] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.802096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.802281] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.802384] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.802478] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a881cc4-1951-445b-9992-f38899556d68 is going to be updated. [ 1395.834928] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.835103] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.835173] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.835369] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.835511] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.843658] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a881cc4-1951-445b-9992-f38899556d68 in Status: IN_PROGRESS for 2s [ 1395.901290] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.901475] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.901557] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.901816] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.902010] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.902165] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.902245] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.902436] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.902576] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.902655] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.902862] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.902944] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.902980] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.903145] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.903284] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.903376] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.903439] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.903578] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.903649] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.903759] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.903822] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.405515] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5a27c39-6a74-49af-904d-9ad757735e77: rpc.has_security_group_logging(os_id): False [ 1396.423472] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.423632] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.423676] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.423888] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.424015] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.424298] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.424417] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.424485] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.424659] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.424742] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.424995] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.425141] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.425207] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.425363] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.425442] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.425693] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.425795] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.425844] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.425993] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.426085] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.426173] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5a27c39-6a74-49af-904d-9ad757735e77 is going to be updated. [ 1396.480387] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.480525] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.480585] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.480850] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.480919] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.492098] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: IN_PROGRESS for 2s [ 1397.853191] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a881cc4-1951-445b-9992-f38899556d68 in Status: SUCCESS [ 1397.853571] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a881cc4-1951-445b-9992-f38899556d68 deletion is rescheduled due to dependency. [ 1397.853571] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a881cc4-1951-445b-9992-f38899556d68" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.506110] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: SUCCESS [ 1398.506338] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.298383] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.298720] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.300071] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.300427] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1410.301351] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.301682] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1414.243198] env[69692]: INFO networking_nsxv3.common.synchronization [req-fc836a0b-ab3f-419c-825e-70b886e9f029 req-7bc1ed4c-0c76-4102-9e9e-a535473b5a15 tempest-ServerRescueTestJSON-453409642 tempest-ServerRescueTestJSON-453409642-project-member] Enqueued Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_members [ 1414.243394] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_members [ 1414.244040] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.244040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.244040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.244040] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.244259] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.244329] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.244386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.244510] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.244589] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.244679] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.746839] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.248801] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.751901] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.752190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.752190] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.752348] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.752444] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.752546] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5a27c39-6a74-49af-904d-9ad757735e77 is going to be updated. [ 1415.784888] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.785016] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.785100] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.785438] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.785540] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.793820] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: IN_PROGRESS for 2s [ 1417.803657] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: SUCCESS [ 1417.804096] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.244263] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.244598] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1420.806737] env[69692]: INFO networking_nsxv3.common.synchronization [req-c259d896-483f-41a5-ab24-ea6040234d3f req-cd6b4643-dbda-4696-b154-0663070162ec tempest-ServerRescueTestJSON-453409642 tempest-ServerRescueTestJSON-453409642-project-member] Enqueued Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_members [ 1420.807321] env[69692]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a27c39-6a74-49af-904d-9ad757735e77 with Priority: HIGHEST for action security_group_members [ 1420.807646] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5a27c39-6a74-49af-904d-9ad757735e77 taken with stack trace [, , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.807728] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.807802] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.808014] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.808173] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.808297] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.808396] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.808514] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.808599] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.808693] env[69692]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5a27c39-6a74-49af-904d-9ad757735e77',) {} {{(pid=69692) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.310680] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.310680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.310680] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.310965] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.311032] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.311218] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.311322] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.311386] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.311542] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.311621] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.311709] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5a27c39-6a74-49af-904d-9ad757735e77 is going to be updated. [ 1421.340047] env[69692]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69692) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.340220] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.340293] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.340469] env[69692]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.340604] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.348450] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: IN_PROGRESS for 2s [ 1423.359397] env[69692]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5a27c39-6a74-49af-904d-9ad757735e77 in Status: SUCCESS [ 1423.359741] env[69692]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5a27c39-6a74-49af-904d-9ad757735e77 deletion is rescheduled due to dependency. [ 1423.359741] env[69692]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5a27c39-6a74-49af-904d-9ad757735e77" {{(pid=69692) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.808601] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.808910] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.809446] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.809765] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.810797] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.811115] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.811771] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.812142] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.813305] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.813672] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1450.814122] env[69692]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1450.814412] env[69692]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0